Oct 30 09:08:03 user nova-compute[75017]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75017) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75017) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75017) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 30 09:08:03 user nova-compute[75017]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:08:03 user nova-compute[75017]: INFO nova.virt.driver [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 30 09:08:03 user nova-compute[75017]: INFO nova.compute.provider_config [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] Acquiring lock "singleton_lock" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] Acquired lock "singleton_lock" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] Releasing lock "singleton_lock" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] Full set of CONF: {{(pid=75017) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ******************************************************************************** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] Configuration options gathered from: {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ================================================================================ {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] allow_resize_to_same_host      = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] arq_binding_timeout            = 300 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] backdoor_port                  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] backdoor_socket                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] block_device_allocate_retries  = 300 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] block_device_allocate_retries_interval = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cert                           = self.pem {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute_monitors               = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] config_dir                     = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] config_drive_format            = iso9660 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] config_source                  = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] console_host                   = user {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] control_exchange               = nova {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cpu_allocation_ratio           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] daemon                         = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] debug                          = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] default_access_ip_network_name = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] default_availability_zone      = nova {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] default_ephemeral_format       = ext4 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] default_green_pool_size        = 1000 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] default_schedule_zone          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] disk_allocation_ratio          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] enable_new_services            = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] enabled_ssl_apis               = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] flat_injected                  = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] force_config_drive             = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] force_raw_images               = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] graceful_shutdown_timeout      = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] heal_instance_info_cache_interval = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] host                           = user {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] instance_build_timeout         = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] instance_delete_interval       = 300 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] instance_name_template         = instance-%08x {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] instance_usage_audit           = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] instance_usage_audit_period    = month {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] internal_service_availability_zone = internal {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] key                            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] live_migration_retry_count     = 30 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] log_config_append              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] log_dir                        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] log_file                       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] log_options                    = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] log_rotate_interval            = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] log_rotate_interval_type       = days {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] log_rotation_type              = none {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] long_rpc_timeout               = 1800 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] max_concurrent_builds          = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] max_concurrent_live_migrations = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] max_concurrent_snapshots       = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] max_local_block_devices        = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] max_logfile_count              = 30 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] max_logfile_size_mb            = 200 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] maximum_instance_delete_attempts = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] metadata_listen                = 0.0.0.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] metadata_listen_port           = 8775 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] metadata_workers               = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] migrate_max_retries            = -1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] mkisofs_cmd                    = genisoimage {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] my_ip                          = 10.0.0.210 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] network_allocate_retries       = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] osapi_compute_listen_port      = 8774 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] osapi_compute_unique_server_name_scope =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] osapi_compute_workers          = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] password_length                = 12 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] periodic_enable                = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] periodic_fuzzy_delay           = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] pointer_model                  = ps2mouse {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] preallocate_images             = none {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] publish_errors                 = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] pybasedir                      = /opt/stack/nova {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ram_allocation_ratio           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] rate_limit_burst               = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] rate_limit_except_level        = CRITICAL {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] rate_limit_interval            = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] reboot_timeout                 = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] reclaim_instance_interval      = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] record                         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] reimage_timeout_per_gb         = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] report_interval                = 120 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] rescue_timeout                 = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] reserved_host_cpus             = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] reserved_host_disk_mb          = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] reserved_host_memory_mb        = 512 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] reserved_huge_pages            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] resize_confirm_window          = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] resize_fs_using_block_device   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] resume_guests_state_on_host_boot = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] rpc_response_timeout           = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] run_external_periodic_tasks    = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] running_deleted_instance_action = reap {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] running_deleted_instance_timeout = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler_instance_sync_interval = 120 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_down_time              = 720 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] servicegroup_driver            = db {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] shelved_offload_time           = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] shelved_poll_interval          = 3600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] shutdown_timeout               = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] source_is_ipv6                 = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ssl_only                       = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] state_path                     = /opt/stack/data/nova {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] sync_power_state_interval      = 600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] sync_power_state_pool_size     = 1000 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] syslog_log_facility            = LOG_USER {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] tempdir                        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] timeout_nbd                    = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] transport_url                  = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] update_resources_interval      = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] use_cow_images                 = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] use_eventlog                   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] use_journal                    = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] use_json                       = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] use_rootwrap_daemon            = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] use_stderr                     = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] use_syslog                     = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vcpu_pin_set                   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plugging_is_fatal          = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plugging_timeout           = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] virt_mkfs                      = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] volume_usage_poll_interval     = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] watch_log_file                 = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] web                            = /usr/share/spice-html5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_concurrency.disable_process_locking = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.auth_strategy              = keystone {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.compute_link_prefix        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.dhcp_domain                = novalocal {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.enable_instance_password   = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.glance_link_prefix         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.instance_list_per_project_cells = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.list_records_by_skipping_down_cells = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.local_metadata_per_cell    = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.max_limit                  = 1000 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.metadata_cache_expiration  = 15 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.neutron_default_tenant_id  = default {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.use_forwarded_for          = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.use_neutron_default_nets   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.vendordata_dynamic_targets = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.vendordata_jsonfile_path   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.backend_argument         = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.config_prefix            = cache.oslo {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.dead_timeout             = 60.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.debug_cache_backend      = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.enable_retry_client      = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.enable_socket_keepalive  = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.enabled                  = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.expiration_time          = 600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.hashclient_retry_attempts = 2 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_dead_retry      = 300 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_password        =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_sasl_enabled    = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.memcache_username        =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.proxies                  = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.retry_attempts           = 2 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.retry_delay              = 0.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.socket_keepalive_count   = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.socket_keepalive_idle    = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.socket_keepalive_interval = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.tls_allowed_ciphers      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.tls_cafile               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.tls_certfile             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.tls_enabled              = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cache.tls_keyfile              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.auth_section            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.auth_type               = password {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.cafile                  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.certfile                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.collect_timing          = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.cross_az_attach         = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.debug                   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.endpoint_template       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.http_retries            = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.insecure                = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.keyfile                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.os_region_name          = RegionOne {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.split_loggers           = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cinder.timeout                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.cpu_dedicated_set      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.cpu_shared_set         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.image_type_exclude_list = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.resource_provider_association_refresh = 300 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.shutdown_retry_interval = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] conductor.workers              = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] console.allowed_origins        = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] console.ssl_ciphers            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] console.ssl_minimum_version    = default {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] consoleauth.token_ttl          = 600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.cafile                  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.certfile                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.collect_timing          = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.connect_retries         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.connect_retry_delay     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.endpoint_override       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.insecure                = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.keyfile                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.max_version             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.min_version             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.region_name             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.service_name            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.service_type            = accelerator {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.split_loggers           = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.status_code_retries     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.status_code_retry_delay = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.timeout                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] cyborg.version                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.backend               = sqlalchemy {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.connection            = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.connection_debug      = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.connection_parameters =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.connection_recycle_time = 3600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.connection_trace      = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.db_inc_retry_interval = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.db_max_retries        = 20 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.db_max_retry_interval = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.db_retry_interval     = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.max_overflow          = 50 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.max_pool_size         = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.max_retries           = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.mysql_wsrep_sync_wait = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.pool_timeout          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.retry_interval        = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.slave_connection      = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] database.sqlite_synchronous    = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.backend           = sqlalchemy {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.connection        = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.connection_debug  = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.connection_parameters =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.connection_recycle_time = 3600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.connection_trace  = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.db_inc_retry_interval = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.db_max_retries    = 20 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.db_max_retry_interval = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.db_retry_interval = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.max_overflow      = 50 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.max_pool_size     = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.max_retries       = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.pool_timeout      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.retry_interval    = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.slave_connection  = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] api_database.sqlite_synchronous = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] devices.enabled_mdev_types     = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ephemeral_storage_encryption.enabled = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.api_servers             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.cafile                  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.certfile                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.collect_timing          = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.connect_retries         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.connect_retry_delay     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.debug                   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.default_trusted_certificate_ids = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.enable_certificate_validation = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.enable_rbd_download     = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.endpoint_override       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.insecure                = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.keyfile                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.max_version             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.min_version             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.num_retries             = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.rbd_ceph_conf           =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.rbd_connect_timeout     = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.rbd_pool                =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.rbd_user                =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.region_name             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.service_name            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.service_type            = image {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.split_loggers           = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.status_code_retries     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.status_code_retry_delay = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.timeout                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.verify_glance_signatures = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] glance.version                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] guestfs.debug                  = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.config_drive_cdrom      = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.config_drive_inject_password = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.enable_remotefx         = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.instances_path_share    =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.limit_cpu_features      = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.use_multipath_io        = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.vswitch_name            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] mks.enabled                    = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] image_cache.manager_interval   = 2400 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] image_cache.precache_concurrency = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] image_cache.remove_unused_base_images = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] image_cache.subdirectory_name  = _base {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.api_max_retries         = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.api_retry_interval      = 2 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.auth_section            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.auth_type               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.cafile                  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.certfile                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.collect_timing          = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.conductor_group         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.connect_retries         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.connect_retry_delay     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.endpoint_override       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.insecure                = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.keyfile                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.max_version             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.min_version             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.peer_list               = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.region_name             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.serial_console_state_timeout = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.service_name            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.service_type            = baremetal {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.split_loggers           = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.status_code_retries     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.status_code_retry_delay = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.timeout                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ironic.version                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] key_manager.fixed_key          = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.barbican_api_version  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.barbican_endpoint     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.barbican_endpoint_type = public {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.barbican_region_name  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.cafile                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.certfile              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.collect_timing        = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.insecure              = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.keyfile               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.number_of_retries     = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.retry_delay           = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.send_service_user_token = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.split_loggers         = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.timeout               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.verify_ssl            = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican.verify_ssl_path       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican_service_user.auth_section = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican_service_user.auth_type = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican_service_user.cafile   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican_service_user.certfile = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican_service_user.collect_timing = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican_service_user.insecure = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican_service_user.keyfile  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican_service_user.split_loggers = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] barbican_service_user.timeout  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.approle_role_id          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.approle_secret_id        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:03 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.cafile                   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.certfile                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.collect_timing           = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.insecure                 = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.keyfile                  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.kv_mountpoint            = secret {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.kv_path                  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.kv_version               = 2 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.namespace                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.root_token_id            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.split_loggers            = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.ssl_ca_crt_file          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.timeout                  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.use_ssl                  = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.auth_section          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.auth_type             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.cafile                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.certfile              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.collect_timing        = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.connect_retries       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.connect_retry_delay   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.endpoint_override     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.insecure              = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.keyfile               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.max_version           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.min_version           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.region_name           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.service_name          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.service_type          = identity {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.split_loggers         = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.status_code_retries   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.status_code_retry_delay = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.timeout               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] keystone.version               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.connection_uri         =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.cpu_mode               = custom {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: WARNING oslo_config.cfg [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.cpu_power_governor_high = performance {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.cpu_power_management   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.device_detach_attempts = 8 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.device_detach_timeout  = 20 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.disk_cachemodes        = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.disk_prefix            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.enabled_perf_events    = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.file_backed_memory     = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.gid_maps               = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.hw_disk_discard        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.hw_machine_type        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.images_rbd_pool        = rbd {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.images_type            = default {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.images_volume_group    = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.inject_key             = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.inject_partition       = -2 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.inject_password        = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.iscsi_iface            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.iser_use_multipath     = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_downtime = 500 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_inbound_addr = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_scheme  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_timeout_action = abort {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_tunnelled = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: WARNING oslo_config.cfg [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 30 09:08:04 user nova-compute[75017]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 30 09:08:04 user nova-compute[75017]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 30 09:08:04 user nova-compute[75017]: and ``live_migration_inbound_addr`` respectively.
Oct 30 09:08:04 user nova-compute[75017]: ).  Its value may be silently ignored in the future.
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.live_migration_with_native_tls = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.max_queues             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.nfs_mount_options      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.num_pcie_ports         = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.pmem_namespaces        = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.quobyte_client_cfg     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rbd_secret_uuid        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rbd_user               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rescue_image_id        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rescue_kernel_id       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.rx_queue_size          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.smbfs_mount_options    =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.snapshot_compression   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.snapshot_image_format  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.sparse_logical_volumes = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.swtpm_enabled          = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.swtpm_group            = tss {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.swtpm_user             = tss {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.sysinfo_serial         = unique {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.tb_cache_size          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.tx_queue_size          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.uid_maps               = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.use_virtio_for_bridges = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.virt_type              = kvm {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.volume_clear           = zero {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.volume_clear_size      = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.volume_use_multipath   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.vzstorage_cache_path   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.auth_section           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.auth_type              = password {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.cafile                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.certfile               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.collect_timing         = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.connect_retries        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.connect_retry_delay    = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.default_floating_pool  = public {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.endpoint_override      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.extension_sync_interval = 600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.http_retries           = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.insecure               = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.keyfile                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.max_version            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.min_version            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.ovs_bridge             = br-int {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.physnets               = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.region_name            = RegionOne {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.service_metadata_proxy = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.service_name           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.service_type           = network {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.split_loggers          = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.status_code_retries    = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.status_code_retry_delay = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.timeout                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] neutron.version                = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] notifications.bdms_in_notifications = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] notifications.default_level    = INFO {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] notifications.notification_format = unversioned {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] notifications.notify_on_state_change = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] pci.alias                      = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] pci.device_spec                = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] pci.report_in_placement        = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.auth_section         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.auth_type            = password {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.cafile               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.certfile             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.collect_timing       = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.connect_retries      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.connect_retry_delay  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.default_domain_id    = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.default_domain_name  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.domain_id            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.domain_name          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.endpoint_override    = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.insecure             = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.keyfile              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.max_version          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.min_version          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.password             = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.project_domain_id    = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.project_domain_name  = Default {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.project_id           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.project_name         = service {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.region_name          = RegionOne {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.service_name         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.service_type         = placement {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.split_loggers        = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.status_code_retries  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.status_code_retry_delay = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.system_scope         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.timeout              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.trust_id             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.user_domain_id       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.user_domain_name     = Default {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.user_id              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.username             = placement {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] placement.version              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.cores                    = 20 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.count_usage_from_placement = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.injected_file_content_bytes = 10240 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.injected_file_path_length = 255 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.injected_files           = 5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.instances                = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.key_pairs                = 100 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.metadata_items           = 128 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.ram                      = 51200 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.recheck_quota            = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.server_group_members     = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] quota.server_groups            = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] rdp.enabled                    = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.image_metadata_prefilter = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.max_attempts         = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.max_placement_results = 1000 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] scheduler.workers              = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.host_subset_size = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.isolated_hosts = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.isolated_images = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.pci_in_placement = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.track_instance_changes = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] metrics.required               = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] metrics.weight_multiplier      = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] metrics.weight_setting         = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] serial_console.enabled         = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] serial_console.port_range      = 10000:20000 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] serial_console.serialproxy_port = 6083 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.auth_section      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.auth_type         = password {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.cafile            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.certfile          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.collect_timing    = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.insecure          = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.keyfile           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.send_service_user_token = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.split_loggers     = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] service_user.timeout           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.agent_enabled            = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.enabled                  = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.html5proxy_port          = 6082 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.image_compression        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.jpeg_compression         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.playback_compression     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.server_listen            = 127.0.0.1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.streaming_mode           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] spice.zlib_compression         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] upgrade_levels.baseapi         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] upgrade_levels.cert            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] upgrade_levels.compute         = auto {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] upgrade_levels.conductor       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] upgrade_levels.scheduler       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vendordata_dynamic_auth.cafile = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vendordata_dynamic_auth.certfile = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vendordata_dynamic_auth.insecure = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vendordata_dynamic_auth.timeout = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.api_retry_count         = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.ca_file                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.cache_prefix            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.cluster_name            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.connection_pool_size    = 10 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.console_delay_seconds   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.datastore_regex         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.host_ip                 = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.host_password           = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.host_port               = 443 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.host_username           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.insecure                = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.integration_bridge      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.maximum_objects         = 100 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.pbm_default_policy      = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.pbm_enabled             = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.pbm_wsdl_location       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.serial_port_proxy_uri   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.serial_port_service_uri = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.task_poll_interval      = 0.5 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.use_linked_clone        = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.vnc_keymap              = en-us {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.vnc_port                = 5900 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vmware.vnc_port_total          = 10000 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.auth_schemes               = ['none'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.enabled                    = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.novncproxy_port            = 6080 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.vencrypt_ca_certs          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.vencrypt_client_cert       = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vnc.vencrypt_client_key        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.disable_rootwrap   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.enable_numa_live_migration = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.libvirt_disable_apic = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.client_socket_timeout     = 900 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.default_pool_size         = 1000 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.keep_alive                = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.max_header_line           = 16384 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.ssl_ca_file               = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.ssl_cert_file             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.ssl_key_file              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.tcp_keepidle              = 600 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] zvm.ca_file                    = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] zvm.cloud_connector_url        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] zvm.reachable_timeout          = 300 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.enforce_new_defaults = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.enforce_scope      = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.policy_default_rule = default {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.connection_string     = messaging:// {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.enabled               = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.es_doc_type           = notification {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.es_scroll_size        = 10000 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.es_scroll_time        = 2m {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.filter_error_trace    = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.hmac_keys             = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.sentinel_service_name = mymaster {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.socket_timeout        = 0.1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.trace_requests        = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler.trace_sqlalchemy      = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler_jaeger.process_tags   = {} {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler_jaeger.service_name_prefix = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] profiler_otlp.service_name_prefix = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] remote_debug.host              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] remote_debug.port              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_notifications.retry = -1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.auth_section        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.auth_type           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.cafile              = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.certfile            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.collect_timing      = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.connect_retries     = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.connect_retry_delay = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.endpoint_id         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.endpoint_override   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.insecure            = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.keyfile             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.max_version         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.min_version         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.region_name         = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.service_name        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.service_type        = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.split_loggers       = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.status_code_retries = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.status_code_retry_delay = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.timeout             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.valid_interfaces    = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_limit.version             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_reports.file_event_handler = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] oslo_reports.log_dir           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_ovs_privileged.group  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] vif_plug_ovs_privileged.user   = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_ovs.isolate_vif         = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] os_brick.lock_path             = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] privsep_osbrick.capabilities   = [21] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] privsep_osbrick.group          = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] privsep_osbrick.helper_command = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] privsep_osbrick.user           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] nova_sys_admin.group           = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] nova_sys_admin.helper_command  = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] nova_sys_admin.user            = None {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG oslo_service.service [None req-ef2c75f8-81b7-46c2-9190-4ec9ac183ab3 None None] ******************************************************************************** {{(pid=75017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 30 09:08:04 user nova-compute[75017]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 30 09:08:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Connecting to libvirt: qemu:///system {{(pid=75017) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7d14392440> {{(pid=75017) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 30 09:08:04 user nova-compute[75017]: libvirt:  error : internal error: could not initialize domain event timer
Oct 30 09:08:04 user nova-compute[75017]: WARNING nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 30 09:08:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7d14392440> {{(pid=75017) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Starting native event thread {{(pid=75017) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Starting green dispatch thread {{(pid=75017) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 30 09:08:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Starting connection event dispatch thread {{(pid=75017) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 30 09:08:04 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Connection event '1' reason 'None'
Oct 30 09:08:04 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 30 09:08:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.mount [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Initialising _HostMountState generation 0 {{(pid=75017) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 30 09:08:11 user nova-compute[75017]: INFO nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt host capabilities <capabilities>
Oct 30 09:08:11 user nova-compute[75017]:   <host>
Oct 30 09:08:11 user nova-compute[75017]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 30 09:08:11 user nova-compute[75017]:     <cpu>
Oct 30 09:08:11 user nova-compute[75017]:       <arch>x86_64</arch>
Oct 30 09:08:11 user nova-compute[75017]:       <model>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <vendor>Intel</vendor>
Oct 30 09:08:11 user nova-compute[75017]:       <microcode version='1070'/>
Oct 30 09:08:11 user nova-compute[75017]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 30 09:08:11 user nova-compute[75017]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='ss'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='vmx'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='pcid'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='osxsave'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='hypervisor'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='arat'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='tsc_adjust'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='md-clear'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='arch-capabilities'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='invtsc'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='rsba'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature name='skip-l1dfl-vmentry'/>
Oct 30 09:08:11 user nova-compute[75017]:       <pages unit='KiB' size='4'/>
Oct 30 09:08:11 user nova-compute[75017]:       <pages unit='KiB' size='2048'/>
Oct 30 09:08:11 user nova-compute[75017]:     </cpu>
Oct 30 09:08:11 user nova-compute[75017]:     <power_management>
Oct 30 09:08:11 user nova-compute[75017]:       <suspend_mem/>
Oct 30 09:08:11 user nova-compute[75017]:       <suspend_disk/>
Oct 30 09:08:11 user nova-compute[75017]:       <suspend_hybrid/>
Oct 30 09:08:11 user nova-compute[75017]:     </power_management>
Oct 30 09:08:11 user nova-compute[75017]:     <iommu support='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     <migration_features>
Oct 30 09:08:11 user nova-compute[75017]:       <live/>
Oct 30 09:08:11 user nova-compute[75017]:       <uri_transports>
Oct 30 09:08:11 user nova-compute[75017]:         <uri_transport>tcp</uri_transport>
Oct 30 09:08:11 user nova-compute[75017]:         <uri_transport>rdma</uri_transport>
Oct 30 09:08:11 user nova-compute[75017]:       </uri_transports>
Oct 30 09:08:11 user nova-compute[75017]:     </migration_features>
Oct 30 09:08:11 user nova-compute[75017]:     <topology>
Oct 30 09:08:11 user nova-compute[75017]:       <cells num='2'>
Oct 30 09:08:11 user nova-compute[75017]:         <cell id='0'>
Oct 30 09:08:11 user nova-compute[75017]:           <memory unit='KiB'>8189224</memory>
Oct 30 09:08:11 user nova-compute[75017]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 30 09:08:11 user nova-compute[75017]:           <pages unit='KiB' size='2048'>0</pages>
Oct 30 09:08:11 user nova-compute[75017]:           <distances>
Oct 30 09:08:11 user nova-compute[75017]:             <sibling id='0' value='10'/>
Oct 30 09:08:11 user nova-compute[75017]:             <sibling id='1' value='20'/>
Oct 30 09:08:11 user nova-compute[75017]:           </distances>
Oct 30 09:08:11 user nova-compute[75017]:           <cpus num='6'>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 30 09:08:11 user nova-compute[75017]:           </cpus>
Oct 30 09:08:11 user nova-compute[75017]:         </cell>
Oct 30 09:08:11 user nova-compute[75017]:         <cell id='1'>
Oct 30 09:08:11 user nova-compute[75017]:           <memory unit='KiB'>8206460</memory>
Oct 30 09:08:11 user nova-compute[75017]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 30 09:08:11 user nova-compute[75017]:           <pages unit='KiB' size='2048'>0</pages>
Oct 30 09:08:11 user nova-compute[75017]:           <distances>
Oct 30 09:08:11 user nova-compute[75017]:             <sibling id='0' value='20'/>
Oct 30 09:08:11 user nova-compute[75017]:             <sibling id='1' value='10'/>
Oct 30 09:08:11 user nova-compute[75017]:           </distances>
Oct 30 09:08:11 user nova-compute[75017]:           <cpus num='6'>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 30 09:08:11 user nova-compute[75017]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 30 09:08:11 user nova-compute[75017]:           </cpus>
Oct 30 09:08:11 user nova-compute[75017]:         </cell>
Oct 30 09:08:11 user nova-compute[75017]:       </cells>
Oct 30 09:08:11 user nova-compute[75017]:     </topology>
Oct 30 09:08:11 user nova-compute[75017]:     <cache>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 30 09:08:11 user nova-compute[75017]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 30 09:08:11 user nova-compute[75017]:     </cache>
Oct 30 09:08:11 user nova-compute[75017]:     <secmodel>
Oct 30 09:08:11 user nova-compute[75017]:       <model>apparmor</model>
Oct 30 09:08:11 user nova-compute[75017]:       <doi>0</doi>
Oct 30 09:08:11 user nova-compute[75017]:     </secmodel>
Oct 30 09:08:11 user nova-compute[75017]:     <secmodel>
Oct 30 09:08:11 user nova-compute[75017]:       <model>dac</model>
Oct 30 09:08:11 user nova-compute[75017]:       <doi>0</doi>
Oct 30 09:08:11 user nova-compute[75017]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 30 09:08:11 user nova-compute[75017]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 30 09:08:11 user nova-compute[75017]:     </secmodel>
Oct 30 09:08:11 user nova-compute[75017]:   </host>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='alpha'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>clipper</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='armv6l'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>integratorcp</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>borzoi</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>spitz</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>nuri</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>musca-b1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>versatileab</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>kzm</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>musca-a</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>smdkc210</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sx1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>z2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>tosa</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>sabrelite</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>realview-eb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>n810</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>n800</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>versatilepb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>terrier</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mainstone</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>midway</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>musicpal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>microbit</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>cubieboard</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>verdex</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>netduino2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>raspi2b</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>cheetah</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>highbank</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>akita</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>connex</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>collie</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>raspi0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='armv7l'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>integratorcp</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>borzoi</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>spitz</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>nuri</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>musca-b1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>versatileab</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>kzm</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>musca-a</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>smdkc210</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sx1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>z2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>tosa</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>sabrelite</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>realview-eb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>n810</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>n800</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>versatilepb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>terrier</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mainstone</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>midway</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>musicpal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>microbit</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>cubieboard</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>verdex</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>netduino2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>raspi2b</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>cheetah</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>highbank</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>akita</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>connex</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>collie</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>raspi0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='aarch64'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>integratorcp</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>borzoi</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>spitz</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>nuri</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>musca-b1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>versatileab</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>kzm</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>musca-a</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>smdkc210</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sx1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>z2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>tosa</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>sabrelite</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>realview-eb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>n810</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>n800</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>versatilepb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>terrier</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mainstone</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>midway</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>musicpal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>microbit</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>cubieboard</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>verdex</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>netduino2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>raspi3b</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>raspi2b</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>cheetah</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>highbank</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>akita</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>connex</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>collie</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>raspi0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <acpi default='on' toggle='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='cris'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='i686'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>x-remote</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>isapc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>microvm</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='kvm'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <pae/>
Oct 30 09:08:11 user nova-compute[75017]:       <nonpae/>
Oct 30 09:08:11 user nova-compute[75017]:       <acpi default='on' toggle='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:       <apic default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='m68k'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>an5206</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>q800</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>next-cube</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='microblaze'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='microblazeel'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='mips'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='16'>malta</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='mipsel'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='16'>malta</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='mips64'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='16'>malta</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>pica61</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>magnum</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='mips64el'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='16'>malta</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>pica61</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>magnum</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='16'>boston</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='ppc'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>g3beige</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mac99</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>ppce500</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>pegasos2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sam460ex</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>bamboo</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>40p</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>ref405ep</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>taihu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='ppc64'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2048'>powernv9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>taihu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2048'>powernv10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>ppce500</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>40p</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>pegasos2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>bamboo</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>g3beige</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mac99</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sam460ex</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>ref405ep</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2048'>powernv8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='ppc64le'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2048'>powernv9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>taihu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2048'>powernv10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>ppce500</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>40p</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>pegasos2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>bamboo</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>g3beige</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>mac99</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sam460ex</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>ref405ep</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2048'>powernv8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='riscv32'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='8'>spike</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>opentitan</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='5'>sifive_u</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sifive_e</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='8'>virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='riscv64'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='8'>spike</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='5'>sifive_u</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>shakti_c</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sifive_e</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='8'>virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='s390x'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='sh4'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>shix</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>r2d</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='sh4eb'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>shix</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>r2d</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='sparc'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>SS-5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>SS-20</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>LX</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>SS-4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>SS-10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>Voyager</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='sparc64'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sun4u</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>niagara</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>sun4v</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='x86_64'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>64</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>x-remote</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='1'>isapc</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>microvm</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='kvm'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <acpi default='on' toggle='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:       <apic default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='xtensa'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>sim</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>kc705</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>ml605</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>lx200</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>lx60</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]:   <guest>
Oct 30 09:08:11 user nova-compute[75017]:     <os_type>hvm</os_type>
Oct 30 09:08:11 user nova-compute[75017]:     <arch name='xtensaeb'>
Oct 30 09:08:11 user nova-compute[75017]:       <wordsize>32</wordsize>
Oct 30 09:08:11 user nova-compute[75017]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='4'>sim</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>kc705</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>ml605</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>virt</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>lx200</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>lx60</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 30 09:08:11 user nova-compute[75017]:       <domain type='qemu'/>
Oct 30 09:08:11 user nova-compute[75017]:     </arch>
Oct 30 09:08:11 user nova-compute[75017]:     <features>
Oct 30 09:08:11 user nova-compute[75017]:       <cpuselection/>
Oct 30 09:08:11 user nova-compute[75017]:       <deviceboot/>
Oct 30 09:08:11 user nova-compute[75017]:       <disksnapshot default='on' toggle='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     </features>
Oct 30 09:08:11 user nova-compute[75017]:   </guest>
Oct 30 09:08:11 user nova-compute[75017]: </capabilities>
Oct 30 09:08:11 user nova-compute[75017]: 
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 30 09:08:11 user nova-compute[75017]: <domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 09:08:11 user nova-compute[75017]:   <domain>kvm</domain>
Oct 30 09:08:11 user nova-compute[75017]:   <machine>pc-q35-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:   <arch>i686</arch>
Oct 30 09:08:11 user nova-compute[75017]:   <vcpu max='288'/>
Oct 30 09:08:11 user nova-compute[75017]:   <iothreads supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:   <os supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='firmware'/>
Oct 30 09:08:11 user nova-compute[75017]:     <loader supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>rom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pflash</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='readonly'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='secure'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </loader>
Oct 30 09:08:11 user nova-compute[75017]:   </os>
Oct 30 09:08:11 user nova-compute[75017]:   <cpu>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-passthrough' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='hostPassthroughMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='maximum' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='maximumMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-model' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <vendor>Intel</vendor>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ss'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='vmx'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pcid'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='hypervisor'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arat'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='umip'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='md-clear'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibpb'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibrs'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='erms'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='lm'/>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='custom' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>qemu64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>qemu32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>phenom</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>n270</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>kvm64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>coreduo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>core2duo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>athlon</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Westmere</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Snowridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Penryn</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G5</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G4</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G1</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Nehalem</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Rome</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Milan</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Dhyana</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cooperlake</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Conroe</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>486</model>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:   </cpu>
Oct 30 09:08:11 user nova-compute[75017]:   <memoryBacking supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='sourceType'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>file</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>anonymous</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>memfd</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:   </memoryBacking>
Oct 30 09:08:11 user nova-compute[75017]:   <devices>
Oct 30 09:08:11 user nova-compute[75017]:     <disk supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='diskDevice'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>disk</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cdrom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>floppy</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>lun</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='bus'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>fdc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sata</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </disk>
Oct 30 09:08:11 user nova-compute[75017]:     <graphics supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sdl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vnc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>spice</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egl-headless</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </graphics>
Oct 30 09:08:11 user nova-compute[75017]:     <video supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='modelType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cirrus</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vmvga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>qxl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>none</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>bochs</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ramfb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </video>
Oct 30 09:08:11 user nova-compute[75017]:     <hostdev supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='mode'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>subsystem</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='startupPolicy'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>default</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>mandatory</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>requisite</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>optional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='subsysType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pci</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='capsType'/>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='pciBackend'/>
Oct 30 09:08:11 user nova-compute[75017]:     </hostdev>
Oct 30 09:08:11 user nova-compute[75017]:     <rng supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>random</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egd</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>builtin</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </rng>
Oct 30 09:08:11 user nova-compute[75017]:     <filesystem supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='driverType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>path</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>handle</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtiofs</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </filesystem>
Oct 30 09:08:11 user nova-compute[75017]:     <tpm supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-tis</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-crb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>passthrough</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>emulator</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </tpm>
Oct 30 09:08:11 user nova-compute[75017]:   </devices>
Oct 30 09:08:11 user nova-compute[75017]:   <features>
Oct 30 09:08:11 user nova-compute[75017]:     <gic supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     <vmcoreinfo supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <genid supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backingStoreInput supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backup supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <sev supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:   </features>
Oct 30 09:08:11 user nova-compute[75017]: </domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:  {{(pid=75017) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 30 09:08:11 user nova-compute[75017]: <domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 09:08:11 user nova-compute[75017]:   <domain>kvm</domain>
Oct 30 09:08:11 user nova-compute[75017]:   <machine>pc-i440fx-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:   <arch>i686</arch>
Oct 30 09:08:11 user nova-compute[75017]:   <vcpu max='255'/>
Oct 30 09:08:11 user nova-compute[75017]:   <iothreads supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:   <os supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='firmware'/>
Oct 30 09:08:11 user nova-compute[75017]:     <loader supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>rom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pflash</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='readonly'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='secure'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </loader>
Oct 30 09:08:11 user nova-compute[75017]:   </os>
Oct 30 09:08:11 user nova-compute[75017]:   <cpu>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-passthrough' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='hostPassthroughMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='maximum' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='maximumMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-model' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <vendor>Intel</vendor>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ss'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='vmx'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pcid'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='hypervisor'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arat'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='umip'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='md-clear'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibpb'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibrs'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='erms'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='lm'/>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='custom' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>qemu64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>qemu32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>phenom</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>n270</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>kvm64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>coreduo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>core2duo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>athlon</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Westmere</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Snowridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Penryn</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G5</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G4</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G1</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Nehalem</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Rome</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Milan</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Dhyana</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cooperlake</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Conroe</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>486</model>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:   </cpu>
Oct 30 09:08:11 user nova-compute[75017]:   <memoryBacking supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='sourceType'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>file</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>anonymous</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>memfd</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:   </memoryBacking>
Oct 30 09:08:11 user nova-compute[75017]:   <devices>
Oct 30 09:08:11 user nova-compute[75017]:     <disk supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='diskDevice'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>disk</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cdrom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>floppy</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>lun</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='bus'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ide</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>fdc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sata</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </disk>
Oct 30 09:08:11 user nova-compute[75017]:     <graphics supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sdl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vnc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>spice</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egl-headless</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </graphics>
Oct 30 09:08:11 user nova-compute[75017]:     <video supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='modelType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cirrus</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vmvga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>qxl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>none</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>bochs</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ramfb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </video>
Oct 30 09:08:11 user nova-compute[75017]:     <hostdev supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='mode'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>subsystem</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='startupPolicy'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>default</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>mandatory</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>requisite</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>optional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='subsysType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pci</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='capsType'/>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='pciBackend'/>
Oct 30 09:08:11 user nova-compute[75017]:     </hostdev>
Oct 30 09:08:11 user nova-compute[75017]:     <rng supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>random</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egd</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>builtin</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </rng>
Oct 30 09:08:11 user nova-compute[75017]:     <filesystem supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='driverType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>path</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>handle</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtiofs</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </filesystem>
Oct 30 09:08:11 user nova-compute[75017]:     <tpm supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-tis</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-crb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>passthrough</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>emulator</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </tpm>
Oct 30 09:08:11 user nova-compute[75017]:   </devices>
Oct 30 09:08:11 user nova-compute[75017]:   <features>
Oct 30 09:08:11 user nova-compute[75017]:     <gic supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     <vmcoreinfo supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <genid supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backingStoreInput supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backup supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <sev supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:   </features>
Oct 30 09:08:11 user nova-compute[75017]: </domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:  {{(pid=75017) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 30 09:08:11 user nova-compute[75017]: <domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 09:08:11 user nova-compute[75017]:   <domain>kvm</domain>
Oct 30 09:08:11 user nova-compute[75017]:   <machine>pc-q35-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:   <arch>i686</arch>
Oct 30 09:08:11 user nova-compute[75017]:   <vcpu max='288'/>
Oct 30 09:08:11 user nova-compute[75017]:   <iothreads supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:   <os supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='firmware'/>
Oct 30 09:08:11 user nova-compute[75017]:     <loader supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>rom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pflash</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='readonly'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='secure'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </loader>
Oct 30 09:08:11 user nova-compute[75017]:   </os>
Oct 30 09:08:11 user nova-compute[75017]:   <cpu>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-passthrough' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='hostPassthroughMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='maximum' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='maximumMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-model' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <vendor>Intel</vendor>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ss'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='vmx'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pcid'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='hypervisor'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arat'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='umip'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='md-clear'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibpb'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibrs'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='erms'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='lm'/>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='custom' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>qemu64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>qemu32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>phenom</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>n270</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>kvm64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>coreduo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>core2duo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>athlon</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Westmere</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Snowridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Penryn</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G5</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G4</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G1</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Nehalem</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Rome</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Milan</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Dhyana</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cooperlake</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Conroe</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>486</model>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:   </cpu>
Oct 30 09:08:11 user nova-compute[75017]:   <memoryBacking supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='sourceType'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>file</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>anonymous</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>memfd</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:   </memoryBacking>
Oct 30 09:08:11 user nova-compute[75017]:   <devices>
Oct 30 09:08:11 user nova-compute[75017]:     <disk supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='diskDevice'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>disk</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cdrom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>floppy</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>lun</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='bus'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>fdc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sata</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </disk>
Oct 30 09:08:11 user nova-compute[75017]:     <graphics supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sdl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vnc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>spice</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egl-headless</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </graphics>
Oct 30 09:08:11 user nova-compute[75017]:     <video supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='modelType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cirrus</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vmvga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>qxl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>none</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>bochs</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ramfb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </video>
Oct 30 09:08:11 user nova-compute[75017]:     <hostdev supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='mode'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>subsystem</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='startupPolicy'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>default</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>mandatory</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>requisite</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>optional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='subsysType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pci</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='capsType'/>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='pciBackend'/>
Oct 30 09:08:11 user nova-compute[75017]:     </hostdev>
Oct 30 09:08:11 user nova-compute[75017]:     <rng supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>random</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egd</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>builtin</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </rng>
Oct 30 09:08:11 user nova-compute[75017]:     <filesystem supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='driverType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>path</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>handle</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtiofs</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </filesystem>
Oct 30 09:08:11 user nova-compute[75017]:     <tpm supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-tis</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-crb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>passthrough</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>emulator</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </tpm>
Oct 30 09:08:11 user nova-compute[75017]:   </devices>
Oct 30 09:08:11 user nova-compute[75017]:   <features>
Oct 30 09:08:11 user nova-compute[75017]:     <gic supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     <vmcoreinfo supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <genid supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backingStoreInput supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backup supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <sev supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:   </features>
Oct 30 09:08:11 user nova-compute[75017]: </domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:  {{(pid=75017) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 30 09:08:11 user nova-compute[75017]: <domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 09:08:11 user nova-compute[75017]:   <domain>kvm</domain>
Oct 30 09:08:11 user nova-compute[75017]:   <machine>pc-i440fx-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:   <arch>i686</arch>
Oct 30 09:08:11 user nova-compute[75017]:   <vcpu max='255'/>
Oct 30 09:08:11 user nova-compute[75017]:   <iothreads supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:   <os supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='firmware'/>
Oct 30 09:08:11 user nova-compute[75017]:     <loader supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>rom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pflash</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='readonly'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='secure'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </loader>
Oct 30 09:08:11 user nova-compute[75017]:   </os>
Oct 30 09:08:11 user nova-compute[75017]:   <cpu>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-passthrough' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='hostPassthroughMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='maximum' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='maximumMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-model' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <vendor>Intel</vendor>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ss'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='vmx'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pcid'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='hypervisor'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arat'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='umip'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='md-clear'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibpb'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibrs'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='erms'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='lm'/>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='custom' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>qemu64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>qemu32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>phenom</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>n270</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>kvm64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>coreduo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>core2duo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>athlon</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Westmere</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Snowridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Penryn</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G5</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G4</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G1</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Nehalem</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Rome</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Milan</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Dhyana</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cooperlake</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Conroe</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>486</model>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:   </cpu>
Oct 30 09:08:11 user nova-compute[75017]:   <memoryBacking supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='sourceType'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>file</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>anonymous</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>memfd</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:   </memoryBacking>
Oct 30 09:08:11 user nova-compute[75017]:   <devices>
Oct 30 09:08:11 user nova-compute[75017]:     <disk supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='diskDevice'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>disk</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cdrom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>floppy</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>lun</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='bus'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ide</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>fdc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sata</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </disk>
Oct 30 09:08:11 user nova-compute[75017]:     <graphics supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sdl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vnc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>spice</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egl-headless</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </graphics>
Oct 30 09:08:11 user nova-compute[75017]:     <video supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='modelType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cirrus</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vmvga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>qxl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>none</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>bochs</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ramfb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </video>
Oct 30 09:08:11 user nova-compute[75017]:     <hostdev supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='mode'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>subsystem</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='startupPolicy'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>default</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>mandatory</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>requisite</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>optional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='subsysType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pci</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='capsType'/>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='pciBackend'/>
Oct 30 09:08:11 user nova-compute[75017]:     </hostdev>
Oct 30 09:08:11 user nova-compute[75017]:     <rng supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>random</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egd</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>builtin</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </rng>
Oct 30 09:08:11 user nova-compute[75017]:     <filesystem supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='driverType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>path</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>handle</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtiofs</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </filesystem>
Oct 30 09:08:11 user nova-compute[75017]:     <tpm supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-tis</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-crb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>passthrough</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>emulator</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </tpm>
Oct 30 09:08:11 user nova-compute[75017]:   </devices>
Oct 30 09:08:11 user nova-compute[75017]:   <features>
Oct 30 09:08:11 user nova-compute[75017]:     <gic supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     <vmcoreinfo supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <genid supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backingStoreInput supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backup supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <sev supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:   </features>
Oct 30 09:08:11 user nova-compute[75017]: </domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:  {{(pid=75017) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 30 09:08:11 user nova-compute[75017]: <domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 09:08:11 user nova-compute[75017]:   <domain>kvm</domain>
Oct 30 09:08:11 user nova-compute[75017]:   <machine>pc-q35-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:   <arch>x86_64</arch>
Oct 30 09:08:11 user nova-compute[75017]:   <vcpu max='288'/>
Oct 30 09:08:11 user nova-compute[75017]:   <iothreads supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:   <os supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='firmware'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>efi</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:     <loader supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>rom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pflash</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='readonly'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='secure'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </loader>
Oct 30 09:08:11 user nova-compute[75017]:   </os>
Oct 30 09:08:11 user nova-compute[75017]:   <cpu>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-passthrough' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='hostPassthroughMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='maximum' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='maximumMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-model' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <vendor>Intel</vendor>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ss'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='vmx'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pcid'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='hypervisor'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arat'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='umip'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='md-clear'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='invtsc'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibpb'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibrs'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='rsba'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='erms'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='custom' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>qemu64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>qemu32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>phenom</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>n270</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>coreduo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>core2duo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>athlon</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Westmere</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Snowridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Penryn</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G5</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G4</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Opteron_G1</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Nehalem</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Rome</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Milan</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Dhyana</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cooperlake</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Conroe</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>486</model>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:   </cpu>
Oct 30 09:08:11 user nova-compute[75017]:   <memoryBacking supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='sourceType'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>file</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>anonymous</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>memfd</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:   </memoryBacking>
Oct 30 09:08:11 user nova-compute[75017]:   <devices>
Oct 30 09:08:11 user nova-compute[75017]:     <disk supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='diskDevice'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>disk</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cdrom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>floppy</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>lun</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='bus'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>fdc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sata</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </disk>
Oct 30 09:08:11 user nova-compute[75017]:     <graphics supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sdl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vnc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>spice</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egl-headless</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </graphics>
Oct 30 09:08:11 user nova-compute[75017]:     <video supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='modelType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cirrus</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vmvga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>qxl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>none</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>bochs</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ramfb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </video>
Oct 30 09:08:11 user nova-compute[75017]:     <hostdev supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='mode'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>subsystem</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='startupPolicy'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>default</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>mandatory</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>requisite</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>optional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='subsysType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pci</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='capsType'/>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='pciBackend'/>
Oct 30 09:08:11 user nova-compute[75017]:     </hostdev>
Oct 30 09:08:11 user nova-compute[75017]:     <rng supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>random</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egd</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>builtin</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </rng>
Oct 30 09:08:11 user nova-compute[75017]:     <filesystem supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='driverType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>path</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>handle</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtiofs</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </filesystem>
Oct 30 09:08:11 user nova-compute[75017]:     <tpm supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-tis</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-crb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>passthrough</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>emulator</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </tpm>
Oct 30 09:08:11 user nova-compute[75017]:   </devices>
Oct 30 09:08:11 user nova-compute[75017]:   <features>
Oct 30 09:08:11 user nova-compute[75017]:     <gic supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     <vmcoreinfo supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <genid supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backingStoreInput supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backup supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <sev supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:   </features>
Oct 30 09:08:11 user nova-compute[75017]: </domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:  {{(pid=75017) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 30 09:08:11 user nova-compute[75017]: <domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 09:08:11 user nova-compute[75017]:   <domain>kvm</domain>
Oct 30 09:08:11 user nova-compute[75017]:   <machine>pc-i440fx-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:   <arch>x86_64</arch>
Oct 30 09:08:11 user nova-compute[75017]:   <vcpu max='255'/>
Oct 30 09:08:11 user nova-compute[75017]:   <iothreads supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:   <os supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='firmware'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>efi</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:     <loader supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>rom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pflash</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='readonly'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='secure'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </loader>
Oct 30 09:08:11 user nova-compute[75017]:   </os>
Oct 30 09:08:11 user nova-compute[75017]:   <cpu>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-passthrough' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='hostPassthroughMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='maximum' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='maximumMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-model' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <vendor>Intel</vendor>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ss'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='vmx'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pcid'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='hypervisor'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arat'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='umip'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='md-clear'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='invtsc'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibpb'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibrs'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='rsba'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='erms'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='custom' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>qemu64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>qemu32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>phenom</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>n270</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>coreduo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>core2duo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>athlon</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Westmere</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Snowridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Penryn</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G5</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G4</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Opteron_G1</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Nehalem</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Rome</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Milan</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Dhyana</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cooperlake</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Conroe</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>486</model>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:   </cpu>
Oct 30 09:08:11 user nova-compute[75017]:   <memoryBacking supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='sourceType'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>file</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>anonymous</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>memfd</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:   </memoryBacking>
Oct 30 09:08:11 user nova-compute[75017]:   <devices>
Oct 30 09:08:11 user nova-compute[75017]:     <disk supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='diskDevice'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>disk</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cdrom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>floppy</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>lun</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='bus'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ide</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>fdc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sata</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </disk>
Oct 30 09:08:11 user nova-compute[75017]:     <graphics supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sdl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vnc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>spice</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egl-headless</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </graphics>
Oct 30 09:08:11 user nova-compute[75017]:     <video supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='modelType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cirrus</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vmvga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>qxl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>none</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>bochs</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ramfb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </video>
Oct 30 09:08:11 user nova-compute[75017]:     <hostdev supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='mode'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>subsystem</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='startupPolicy'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>default</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>mandatory</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>requisite</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>optional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='subsysType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pci</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='capsType'/>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='pciBackend'/>
Oct 30 09:08:11 user nova-compute[75017]:     </hostdev>
Oct 30 09:08:11 user nova-compute[75017]:     <rng supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>random</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egd</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>builtin</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </rng>
Oct 30 09:08:11 user nova-compute[75017]:     <filesystem supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='driverType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>path</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>handle</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtiofs</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </filesystem>
Oct 30 09:08:11 user nova-compute[75017]:     <tpm supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-tis</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-crb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>passthrough</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>emulator</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </tpm>
Oct 30 09:08:11 user nova-compute[75017]:   </devices>
Oct 30 09:08:11 user nova-compute[75017]:   <features>
Oct 30 09:08:11 user nova-compute[75017]:     <gic supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     <vmcoreinfo supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <genid supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backingStoreInput supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backup supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <sev supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:   </features>
Oct 30 09:08:11 user nova-compute[75017]: </domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:  {{(pid=75017) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 30 09:08:11 user nova-compute[75017]: <domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 09:08:11 user nova-compute[75017]:   <domain>kvm</domain>
Oct 30 09:08:11 user nova-compute[75017]:   <machine>pc-q35-6.2</machine>
Oct 30 09:08:11 user nova-compute[75017]:   <arch>x86_64</arch>
Oct 30 09:08:11 user nova-compute[75017]:   <vcpu max='288'/>
Oct 30 09:08:11 user nova-compute[75017]:   <iothreads supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:   <os supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='firmware'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>efi</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:     <loader supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>rom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pflash</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='readonly'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='secure'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </loader>
Oct 30 09:08:11 user nova-compute[75017]:   </os>
Oct 30 09:08:11 user nova-compute[75017]:   <cpu>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-passthrough' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='hostPassthroughMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='maximum' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='maximumMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-model' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <vendor>Intel</vendor>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ss'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='vmx'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pcid'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='hypervisor'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arat'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='umip'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='md-clear'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='invtsc'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibpb'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibrs'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='rsba'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='erms'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='custom' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>qemu64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>qemu32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>phenom</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>n270</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>coreduo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>core2duo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>athlon</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Westmere</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Snowridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Penryn</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G5</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G4</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Opteron_G1</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Nehalem</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Rome</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Milan</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Dhyana</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cooperlake</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Conroe</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>486</model>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:   </cpu>
Oct 30 09:08:11 user nova-compute[75017]:   <memoryBacking supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='sourceType'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>file</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>anonymous</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>memfd</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:   </memoryBacking>
Oct 30 09:08:11 user nova-compute[75017]:   <devices>
Oct 30 09:08:11 user nova-compute[75017]:     <disk supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='diskDevice'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>disk</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cdrom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>floppy</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>lun</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='bus'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>fdc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sata</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </disk>
Oct 30 09:08:11 user nova-compute[75017]:     <graphics supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sdl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vnc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>spice</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egl-headless</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </graphics>
Oct 30 09:08:11 user nova-compute[75017]:     <video supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='modelType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cirrus</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vmvga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>qxl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>none</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>bochs</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ramfb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </video>
Oct 30 09:08:11 user nova-compute[75017]:     <hostdev supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='mode'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>subsystem</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='startupPolicy'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>default</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>mandatory</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>requisite</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>optional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='subsysType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pci</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='capsType'/>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='pciBackend'/>
Oct 30 09:08:11 user nova-compute[75017]:     </hostdev>
Oct 30 09:08:11 user nova-compute[75017]:     <rng supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>random</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egd</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>builtin</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </rng>
Oct 30 09:08:11 user nova-compute[75017]:     <filesystem supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='driverType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>path</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>handle</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtiofs</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </filesystem>
Oct 30 09:08:11 user nova-compute[75017]:     <tpm supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-tis</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-crb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>passthrough</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>emulator</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </tpm>
Oct 30 09:08:11 user nova-compute[75017]:   </devices>
Oct 30 09:08:11 user nova-compute[75017]:   <features>
Oct 30 09:08:11 user nova-compute[75017]:     <gic supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     <vmcoreinfo supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <genid supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backingStoreInput supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backup supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <sev supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:   </features>
Oct 30 09:08:11 user nova-compute[75017]: </domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:  {{(pid=75017) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 30 09:08:11 user nova-compute[75017]: <domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 09:08:11 user nova-compute[75017]:   <domain>kvm</domain>
Oct 30 09:08:11 user nova-compute[75017]:   <machine>pc-i440fx-jammy</machine>
Oct 30 09:08:11 user nova-compute[75017]:   <arch>x86_64</arch>
Oct 30 09:08:11 user nova-compute[75017]:   <vcpu max='255'/>
Oct 30 09:08:11 user nova-compute[75017]:   <iothreads supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:   <os supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='firmware'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>efi</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:     <loader supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>rom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pflash</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='readonly'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>yes</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='secure'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>no</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </loader>
Oct 30 09:08:11 user nova-compute[75017]:   </os>
Oct 30 09:08:11 user nova-compute[75017]:   <cpu>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-passthrough' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='hostPassthroughMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='maximum' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='maximumMigratable'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>on</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>off</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='host-model' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <vendor>Intel</vendor>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ss'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='vmx'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pcid'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='hypervisor'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arat'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='umip'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='md-clear'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='invtsc'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibpb'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='ibrs'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-stibp'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='rsba'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='erms'/>
Oct 30 09:08:11 user nova-compute[75017]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:     <mode name='custom' supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>qemu64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>qemu32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>phenom</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>pentium</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>n270</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm64</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>kvm32</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>coreduo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>core2duo</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>athlon</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Westmere</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Snowridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Skylake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>SandyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Penryn</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G5</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G4</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G3</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Opteron_G2</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Opteron_G1</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Nehalem</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>IvyBridge</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Icelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Haswell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Rome</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-Milan</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>EPYC</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Dhyana</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cooperlake</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>Conroe</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='no'>Broadwell</model>
Oct 30 09:08:11 user nova-compute[75017]:       <model usable='yes'>486</model>
Oct 30 09:08:11 user nova-compute[75017]:     </mode>
Oct 30 09:08:11 user nova-compute[75017]:   </cpu>
Oct 30 09:08:11 user nova-compute[75017]:   <memoryBacking supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:     <enum name='sourceType'>
Oct 30 09:08:11 user nova-compute[75017]:       <value>file</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>anonymous</value>
Oct 30 09:08:11 user nova-compute[75017]:       <value>memfd</value>
Oct 30 09:08:11 user nova-compute[75017]:     </enum>
Oct 30 09:08:11 user nova-compute[75017]:   </memoryBacking>
Oct 30 09:08:11 user nova-compute[75017]:   <devices>
Oct 30 09:08:11 user nova-compute[75017]:     <disk supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='diskDevice'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>disk</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cdrom</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>floppy</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>lun</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='bus'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ide</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>fdc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sata</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </disk>
Oct 30 09:08:11 user nova-compute[75017]:     <graphics supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='type'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>sdl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vnc</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>spice</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egl-headless</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </graphics>
Oct 30 09:08:11 user nova-compute[75017]:     <video supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='modelType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>cirrus</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>vmvga</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>qxl</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>none</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>bochs</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>ramfb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </video>
Oct 30 09:08:11 user nova-compute[75017]:     <hostdev supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='mode'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>subsystem</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='startupPolicy'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>default</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>mandatory</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>requisite</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>optional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='subsysType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>usb</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>pci</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>scsi</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='capsType'/>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='pciBackend'/>
Oct 30 09:08:11 user nova-compute[75017]:     </hostdev>
Oct 30 09:08:11 user nova-compute[75017]:     <rng supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtio-non-transitional</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>random</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>egd</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>builtin</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </rng>
Oct 30 09:08:11 user nova-compute[75017]:     <filesystem supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='driverType'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>path</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>handle</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>virtiofs</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </filesystem>
Oct 30 09:08:11 user nova-compute[75017]:     <tpm supported='yes'>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='model'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-tis</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>tpm-crb</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:       <enum name='backendModel'>
Oct 30 09:08:11 user nova-compute[75017]:         <value>passthrough</value>
Oct 30 09:08:11 user nova-compute[75017]:         <value>emulator</value>
Oct 30 09:08:11 user nova-compute[75017]:       </enum>
Oct 30 09:08:11 user nova-compute[75017]:     </tpm>
Oct 30 09:08:11 user nova-compute[75017]:   </devices>
Oct 30 09:08:11 user nova-compute[75017]:   <features>
Oct 30 09:08:11 user nova-compute[75017]:     <gic supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:     <vmcoreinfo supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <genid supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backingStoreInput supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <backup supported='yes'/>
Oct 30 09:08:11 user nova-compute[75017]:     <sev supported='no'/>
Oct 30 09:08:11 user nova-compute[75017]:   </features>
Oct 30 09:08:11 user nova-compute[75017]: </domainCapabilities>
Oct 30 09:08:11 user nova-compute[75017]:  {{(pid=75017) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75017) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75017) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Checking secure boot support for host arch (x86_64) {{(pid=75017) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 30 09:08:11 user nova-compute[75017]: INFO nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Secure Boot support detected
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] cpu compare xml: <cpu match="exact">
Oct 30 09:08:11 user nova-compute[75017]:   <model>Nehalem</model>
Oct 30 09:08:11 user nova-compute[75017]: </cpu>
Oct 30 09:08:11 user nova-compute[75017]:  {{(pid=75017) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 30 09:08:11 user nova-compute[75017]: INFO nova.virt.node [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Generated node identity f288afb1-3149-4266-a22d-d1442c72ffe3
Oct 30 09:08:11 user nova-compute[75017]: INFO nova.virt.node [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Wrote node identity f288afb1-3149-4266-a22d-d1442c72ffe3 to /opt/stack/data/nova/compute_id
Oct 30 09:08:11 user nova-compute[75017]: WARNING nova.compute.manager [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Compute nodes ['f288afb1-3149-4266-a22d-d1442c72ffe3'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 30 09:08:11 user nova-compute[75017]: INFO nova.compute.manager [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 30 09:08:11 user nova-compute[75017]: WARNING nova.compute.manager [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 30 09:08:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:08:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:08:12 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:08:12 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Hypervisor/Node resource view: name=user free_ram=10953MB free_disk=26.118488311767578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:08:12 user nova-compute[75017]: WARNING nova.compute.resource_tracker [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] No compute node record for user:f288afb1-3149-4266-a22d-d1442c72ffe3: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f288afb1-3149-4266-a22d-d1442c72ffe3 could not be found.
Oct 30 09:08:12 user nova-compute[75017]: INFO nova.compute.resource_tracker [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Compute node record created for user:user with uuid: f288afb1-3149-4266-a22d-d1442c72ffe3
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:08:12 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] [req-a049f566-6c6f-4cdf-8c00-b1618536cfd6] Created resource provider record via placement API for resource provider with UUID f288afb1-3149-4266-a22d-d1442c72ffe3 and name user.
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75017) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 30 09:08:12 user nova-compute[75017]: INFO nova.virt.libvirt.host [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] kernel doesn't support AMD SEV
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Libvirt baseline CPU <cpu>
Oct 30 09:08:12 user nova-compute[75017]:   <arch>x86_64</arch>
Oct 30 09:08:12 user nova-compute[75017]:   <model>Nehalem</model>
Oct 30 09:08:12 user nova-compute[75017]:   <vendor>Intel</vendor>
Oct 30 09:08:12 user nova-compute[75017]:   <topology sockets="6" cores="1" threads="1"/>
Oct 30 09:08:12 user nova-compute[75017]: </cpu>
Oct 30 09:08:12 user nova-compute[75017]:  {{(pid=75017) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Updated inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Updating resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 generation from 0 to 1 during operation: update_inventory {{(pid=75017) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Updating resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 generation from 1 to 2 during operation: update_traits {{(pid=75017) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.service [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Creating RPC server for service compute {{(pid=75017) start /opt/stack/nova/nova/service.py:182}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.service [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] Join ServiceGroup membership for this service compute {{(pid=75017) start /opt/stack/nova/nova/service.py:199}}
Oct 30 09:08:12 user nova-compute[75017]: DEBUG nova.servicegroup.drivers.db [None req-4e4d6ae3-b055-4d0f-94d8-cd8d02cc3765 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75017) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 30 09:08:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:08:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:09:03 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:09:03 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=10387MB free_disk=26.022235870361328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:09:03 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:09:04 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:09:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:10:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:04 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:04 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:04 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:04 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:04 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:04 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:04 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:10:05 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:10:05 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=10314MB free_disk=26.08618927001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:10:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:11:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:11:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:11:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:11:04 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:11:05 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:11:05 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:11:05 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=10300MB free_disk=25.839954376220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:11:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:11:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:11:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:11:06 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:11:06 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:11:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:11:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:11:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:11:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:12:06 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:06 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=9565MB free_disk=25.859935760498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:12:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:12:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:12:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:12:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:12:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:12:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:12:15 user nova-compute[75017]: INFO nova.compute.claims [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Claim successful on node user
Oct 30 09:12:15 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:12:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:12:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:12:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Creating image(s)
Oct 30 09:12:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "/opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "/opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "/opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:16 user nova-compute[75017]: DEBUG nova.policy [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea5cdd1050e8480ebd5686030df32f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3839f70b8e941b886948ff6b370b43b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:12:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:16 user nova-compute[75017]: DEBUG nova.virt.images [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] bfd0d0c2-d64f-40a2-8d8e-991cce6f8585 was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:12:16 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:12:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1.part /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1.part /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1.converted" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.540s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:17 user nova-compute[75017]: INFO oslo.privsep.daemon [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdw_kxhig/privsep.sock']
Oct 30 09:12:17 user sudo[84262]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdw_kxhig/privsep.sock
Oct 30 09:12:17 user sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 30 09:12:18 user sudo[84262]: pam_unix(sudo:session): session closed for user root
Oct 30 09:12:18 user nova-compute[75017]: INFO oslo.privsep.daemon [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Spawned new privsep daemon via rootwrap
Oct 30 09:12:18 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 30 09:12:18 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 30 09:12:18 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 30 09:12:18 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84265
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG nova.network.neutron [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Successfully created port: b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk 1073741824" returned: 0 in 0.056s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Cannot resize image /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Ensure instance console log exists: /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:21 user nova-compute[75017]: DEBUG nova.network.neutron [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Successfully updated port: b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:12:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "refresh_cache-85ebda2b-e8bb-4931-9355-4e411d1aece9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquired lock "refresh_cache-85ebda2b-e8bb-4931-9355-4e411d1aece9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:21 user nova-compute[75017]: DEBUG nova.network.neutron [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:12:21 user nova-compute[75017]: DEBUG nova.network.neutron [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:12:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-36cefd88-5d38-4041-b2c4-29b5afe06835 req-927c9123-06c0-47fb-9a8e-55bf1b164efd service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received event network-changed-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-36cefd88-5d38-4041-b2c4-29b5afe06835 req-927c9123-06c0-47fb-9a8e-55bf1b164efd service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Refreshing instance network info cache due to event network-changed-b03ff3cd-2f01-42df-9c9e-124cbdea975f. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:12:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36cefd88-5d38-4041-b2c4-29b5afe06835 req-927c9123-06c0-47fb-9a8e-55bf1b164efd service nova] Acquiring lock "refresh_cache-85ebda2b-e8bb-4931-9355-4e411d1aece9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Updating instance_info_cache with network_info: [{"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Releasing lock "refresh_cache-85ebda2b-e8bb-4931-9355-4e411d1aece9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Instance network_info: |[{"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36cefd88-5d38-4041-b2c4-29b5afe06835 req-927c9123-06c0-47fb-9a8e-55bf1b164efd service nova] Acquired lock "refresh_cache-85ebda2b-e8bb-4931-9355-4e411d1aece9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.network.neutron [req-36cefd88-5d38-4041-b2c4-29b5afe06835 req-927c9123-06c0-47fb-9a8e-55bf1b164efd service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Refreshing network info cache for port b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Start _get_guest_xml network_info=[{"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:12:22 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:22 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1477754800',display_name='tempest-DeleteServersTestJSON-server-1477754800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1477754800',id=1,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3839f70b8e941b886948ff6b370b43b',ramdisk_id='',reservation_id='r-6qbolaej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-891108301',owner_user_name='tempest-DeleteServersTestJSON-891108301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:16Z,user_data=None,user_id='ea5cdd1050e8480ebd5686030df32f65',uuid=85ebda2b-e8bb-4931-9355-4e411d1aece9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Converting VIF {"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:6e,bridge_name='br-int',has_traffic_filtering=True,id=b03ff3cd-2f01-42df-9c9e-124cbdea975f,network=Network(b94c5ac5-1216-481a-b351-1a8c52c417b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb03ff3cd-2f') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.objects.instance [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lazy-loading 'pci_devices' on Instance uuid 85ebda2b-e8bb-4931-9355-4e411d1aece9 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:12:22 user nova-compute[75017]:   <uuid>85ebda2b-e8bb-4931-9355-4e411d1aece9</uuid>
Oct 30 09:12:22 user nova-compute[75017]:   <name>instance-00000001</name>
Oct 30 09:12:22 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:12:22 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:12:22 user nova-compute[75017]:   <metadata>
Oct 30 09:12:22 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:12:22 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:12:22 user nova-compute[75017]:       <nova:name>tempest-DeleteServersTestJSON-server-1477754800</nova:name>
Oct 30 09:12:22 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:12:22</nova:creationTime>
Oct 30 09:12:22 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:12:22 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:12:22 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:12:22 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:12:22 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:12:22 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:12:22 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:12:22 user nova-compute[75017]:       <nova:owner>
Oct 30 09:12:22 user nova-compute[75017]:         <nova:user uuid="ea5cdd1050e8480ebd5686030df32f65">tempest-DeleteServersTestJSON-891108301-project-member</nova:user>
Oct 30 09:12:22 user nova-compute[75017]:         <nova:project uuid="f3839f70b8e941b886948ff6b370b43b">tempest-DeleteServersTestJSON-891108301</nova:project>
Oct 30 09:12:22 user nova-compute[75017]:       </nova:owner>
Oct 30 09:12:22 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:12:22 user nova-compute[75017]:       <nova:ports>
Oct 30 09:12:22 user nova-compute[75017]:         <nova:port uuid="b03ff3cd-2f01-42df-9c9e-124cbdea975f">
Oct 30 09:12:22 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 09:12:22 user nova-compute[75017]:         </nova:port>
Oct 30 09:12:22 user nova-compute[75017]:       </nova:ports>
Oct 30 09:12:22 user nova-compute[75017]:     </nova:instance>
Oct 30 09:12:22 user nova-compute[75017]:   </metadata>
Oct 30 09:12:22 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:12:22 user nova-compute[75017]:     <system>
Oct 30 09:12:22 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:12:22 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:12:22 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:12:22 user nova-compute[75017]:       <entry name="serial">85ebda2b-e8bb-4931-9355-4e411d1aece9</entry>
Oct 30 09:12:22 user nova-compute[75017]:       <entry name="uuid">85ebda2b-e8bb-4931-9355-4e411d1aece9</entry>
Oct 30 09:12:22 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:12:22 user nova-compute[75017]:     </system>
Oct 30 09:12:22 user nova-compute[75017]:   </sysinfo>
Oct 30 09:12:22 user nova-compute[75017]:   <os>
Oct 30 09:12:22 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:12:22 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:12:22 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:12:22 user nova-compute[75017]:   </os>
Oct 30 09:12:22 user nova-compute[75017]:   <features>
Oct 30 09:12:22 user nova-compute[75017]:     <acpi/>
Oct 30 09:12:22 user nova-compute[75017]:     <apic/>
Oct 30 09:12:22 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:12:22 user nova-compute[75017]:   </features>
Oct 30 09:12:22 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:12:22 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:12:22 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:12:22 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:12:22 user nova-compute[75017]:   </clock>
Oct 30 09:12:22 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:12:22 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:12:22 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:12:22 user nova-compute[75017]:   </cpu>
Oct 30 09:12:22 user nova-compute[75017]:   <devices>
Oct 30 09:12:22 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:12:22 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:12:22 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk"/>
Oct 30 09:12:22 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:12:22 user nova-compute[75017]:     </disk>
Oct 30 09:12:22 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:12:22 user nova-compute[75017]:       <mac address="fa:16:3e:1a:1f:6e"/>
Oct 30 09:12:22 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:22 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:12:22 user nova-compute[75017]:       <target dev="tapb03ff3cd-2f"/>
Oct 30 09:12:22 user nova-compute[75017]:     </interface>
Oct 30 09:12:22 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:12:22 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/console.log" append="off"/>
Oct 30 09:12:22 user nova-compute[75017]:     </serial>
Oct 30 09:12:22 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:12:22 user nova-compute[75017]:     <video>
Oct 30 09:12:22 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:22 user nova-compute[75017]:     </video>
Oct 30 09:12:22 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:12:22 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:12:22 user nova-compute[75017]:     </rng>
Oct 30 09:12:22 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:12:22 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:12:22 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:12:22 user nova-compute[75017]:     </memballoon>
Oct 30 09:12:22 user nova-compute[75017]:   </devices>
Oct 30 09:12:22 user nova-compute[75017]: </domain>
Oct 30 09:12:22 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1477754800',display_name='tempest-DeleteServersTestJSON-server-1477754800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1477754800',id=1,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3839f70b8e941b886948ff6b370b43b',ramdisk_id='',reservation_id='r-6qbolaej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-891108301',owner_user_name='tempest-DeleteServersTestJSON-891108301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:16Z,user_data=None,user_id='ea5cdd1050e8480ebd5686030df32f65',uuid=85ebda2b-e8bb-4931-9355-4e411d1aece9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Converting VIF {"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:6e,bridge_name='br-int',has_traffic_filtering=True,id=b03ff3cd-2f01-42df-9c9e-124cbdea975f,network=Network(b94c5ac5-1216-481a-b351-1a8c52c417b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb03ff3cd-2f') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG os_vif [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:6e,bridge_name='br-int',has_traffic_filtering=True,id=b03ff3cd-2f01-42df-9c9e-124cbdea975f,network=Network(b94c5ac5-1216-481a-b351-1a8c52c417b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb03ff3cd-2f') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Created schema index Interface.name {{(pid=75017) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Created schema index Port.name {{(pid=75017) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Created schema index Bridge.name {{(pid=75017) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [POLLOUT] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4ac06ed-a198-51e9-886e-17231606f47f', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:22 user nova-compute[75017]: INFO oslo.privsep.daemon [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpwsvhd9fg/privsep.sock']
Oct 30 09:12:22 user sudo[84326]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpwsvhd9fg/privsep.sock
Oct 30 09:12:22 user sudo[84326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 30 09:12:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:12:22 user nova-compute[75017]: INFO nova.compute.claims [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Claim successful on node user
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:12:23 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:12:23 user nova-compute[75017]: INFO nova.compute.claims [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Claim successful on node user
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-36cefd88-5d38-4041-b2c4-29b5afe06835 req-927c9123-06c0-47fb-9a8e-55bf1b164efd service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Updated VIF entry in instance network info cache for port b03ff3cd-2f01-42df-9c9e-124cbdea975f. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-36cefd88-5d38-4041-b2c4-29b5afe06835 req-927c9123-06c0-47fb-9a8e-55bf1b164efd service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Updating instance_info_cache with network_info: [{"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36cefd88-5d38-4041-b2c4-29b5afe06835 req-927c9123-06c0-47fb-9a8e-55bf1b164efd service nova] Releasing lock "refresh_cache-85ebda2b-e8bb-4931-9355-4e411d1aece9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.policy [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'edd9037b1ceb4b899f6d446b565a6ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4606fc32534a589e07baa3a4e76d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:12:23 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Creating image(s)
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "/opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "/opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "/opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.network.neutron [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:12:23 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.240s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG nova.policy [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '257ef30aa08d49a387932c340a8589c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20765fc27454d25a1f53e540a8cb4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk 1073741824" returned: 0 in 0.081s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:12:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Creating image(s)
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "/opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "/opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "/opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:24 user sudo[84326]: pam_unix(sudo:session): session closed for user root
Oct 30 09:12:24 user nova-compute[75017]: INFO oslo.privsep.daemon [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Spawned new privsep daemon via rootwrap
Oct 30 09:12:24 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 30 09:12:24 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 30 09:12:24 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 30 09:12:24 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84335
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.220s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Cannot resize image /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Ensure instance console log exists: /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.220s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk 1073741824" returned: 0 in 0.061s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.191s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb03ff3cd-2f, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb03ff3cd-2f, col_values=(('qos', UUID('09c55fc3-a9c5-462a-8a70-a8907fb7fb7a')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb03ff3cd-2f, col_values=(('external_ids', {'iface-id': 'b03ff3cd-2f01-42df-9c9e-124cbdea975f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:1f:6e', 'vm-uuid': '85ebda2b-e8bb-4931-9355-4e411d1aece9'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:24 user nova-compute[75017]: INFO os_vif [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:6e,bridge_name='br-int',has_traffic_filtering=True,id=b03ff3cd-2f01-42df-9c9e-124cbdea975f,network=Network(b94c5ac5-1216-481a-b351-1a8c52c417b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb03ff3cd-2f')
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Cannot resize image /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Ensure instance console log exists: /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:12:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] No VIF found with MAC fa:16:3e:1a:1f:6e, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:12:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:25 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Successfully created port: 834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:12:25 user nova-compute[75017]: DEBUG nova.network.neutron [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Successfully created port: 06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:12:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Successfully updated port: 834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquired lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-b4bc0ed1-70d9-458f-be91-4624ef14bece req-5f31ffb0-7b4e-439d-9ec3-814424255dd2 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received event network-changed-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-b4bc0ed1-70d9-458f-be91-4624ef14bece req-5f31ffb0-7b4e-439d-9ec3-814424255dd2 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Refreshing instance network info cache due to event network-changed-834b1d2f-e0bb-4ba4-a21d-126b54f6f432. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4bc0ed1-70d9-458f-be91-4624ef14bece req-5f31ffb0-7b4e-439d-9ec3-814424255dd2 service nova] Acquiring lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Successfully updated port: 06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquired lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-c55d22c1-0da4-47a9-bb69-55afbf2604bf req-717bf590-c430-4ea5-847e-da792847caa5 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received event network-changed-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-c55d22c1-0da4-47a9-bb69-55afbf2604bf req-717bf590-c430-4ea5-847e-da792847caa5 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Refreshing instance network info cache due to event network-changed-06e70bc3-b779-49b1-be07-0e5247690823. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c55d22c1-0da4-47a9-bb69-55afbf2604bf req-717bf590-c430-4ea5-847e-da792847caa5 service nova] Acquiring lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Updating instance_info_cache with network_info: [{"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Releasing lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Instance network_info: |[{"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4bc0ed1-70d9-458f-be91-4624ef14bece req-5f31ffb0-7b4e-439d-9ec3-814424255dd2 service nova] Acquired lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.network.neutron [req-b4bc0ed1-70d9-458f-be91-4624ef14bece req-5f31ffb0-7b4e-439d-9ec3-814424255dd2 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Refreshing network info cache for port 834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Start _get_guest_xml network_info=[{"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:12:28 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:28 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-13442871',display_name='tempest-AttachVolumeNegativeTest-server-13442871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-13442871',id=2,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaBcNhxje2Oe7fvibCzJy2iyKBuqlN1rli6OhXKFDyJ5Yvc4rnmJImr4MEXarG0i1UBXEN8cpqceIsJHxOin/B0HjIbOmO3jz1EHyyrDXLIjDrHV3CElL7zwrkupJ0v4A==',key_name='tempest-keypair-501313045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-vbr7v7vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=d46e94f6-465d-4112-868e-acf8cea4f402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=834b1d2f-e0bb-4ba4-a21d-126b54f6f432,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834b1d2f-e0') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.objects.instance [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'pci_devices' on Instance uuid d46e94f6-465d-4112-868e-acf8cea4f402 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:12:28 user nova-compute[75017]:   <uuid>d46e94f6-465d-4112-868e-acf8cea4f402</uuid>
Oct 30 09:12:28 user nova-compute[75017]:   <name>instance-00000002</name>
Oct 30 09:12:28 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:12:28 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:12:28 user nova-compute[75017]:   <metadata>
Oct 30 09:12:28 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:12:28 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:12:28 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeNegativeTest-server-13442871</nova:name>
Oct 30 09:12:28 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:12:28</nova:creationTime>
Oct 30 09:12:28 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:12:28 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:12:28 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:12:28 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:12:28 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:12:28 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:12:28 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:12:28 user nova-compute[75017]:       <nova:owner>
Oct 30 09:12:28 user nova-compute[75017]:         <nova:user uuid="edd9037b1ceb4b899f6d446b565a6ff9">tempest-AttachVolumeNegativeTest-63898760-project-member</nova:user>
Oct 30 09:12:28 user nova-compute[75017]:         <nova:project uuid="2a4606fc32534a589e07baa3a4e76d48">tempest-AttachVolumeNegativeTest-63898760</nova:project>
Oct 30 09:12:28 user nova-compute[75017]:       </nova:owner>
Oct 30 09:12:28 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:12:28 user nova-compute[75017]:       <nova:ports>
Oct 30 09:12:28 user nova-compute[75017]:         <nova:port uuid="834b1d2f-e0bb-4ba4-a21d-126b54f6f432">
Oct 30 09:12:28 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 09:12:28 user nova-compute[75017]:         </nova:port>
Oct 30 09:12:28 user nova-compute[75017]:       </nova:ports>
Oct 30 09:12:28 user nova-compute[75017]:     </nova:instance>
Oct 30 09:12:28 user nova-compute[75017]:   </metadata>
Oct 30 09:12:28 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:12:28 user nova-compute[75017]:     <system>
Oct 30 09:12:28 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:12:28 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:12:28 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:12:28 user nova-compute[75017]:       <entry name="serial">d46e94f6-465d-4112-868e-acf8cea4f402</entry>
Oct 30 09:12:28 user nova-compute[75017]:       <entry name="uuid">d46e94f6-465d-4112-868e-acf8cea4f402</entry>
Oct 30 09:12:28 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:12:28 user nova-compute[75017]:     </system>
Oct 30 09:12:28 user nova-compute[75017]:   </sysinfo>
Oct 30 09:12:28 user nova-compute[75017]:   <os>
Oct 30 09:12:28 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:12:28 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:12:28 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:12:28 user nova-compute[75017]:   </os>
Oct 30 09:12:28 user nova-compute[75017]:   <features>
Oct 30 09:12:28 user nova-compute[75017]:     <acpi/>
Oct 30 09:12:28 user nova-compute[75017]:     <apic/>
Oct 30 09:12:28 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:12:28 user nova-compute[75017]:   </features>
Oct 30 09:12:28 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:12:28 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:12:28 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:12:28 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:12:28 user nova-compute[75017]:   </clock>
Oct 30 09:12:28 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:12:28 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:12:28 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:12:28 user nova-compute[75017]:   </cpu>
Oct 30 09:12:28 user nova-compute[75017]:   <devices>
Oct 30 09:12:28 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:12:28 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:12:28 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk"/>
Oct 30 09:12:28 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:12:28 user nova-compute[75017]:     </disk>
Oct 30 09:12:28 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:12:28 user nova-compute[75017]:       <mac address="fa:16:3e:c0:ef:8b"/>
Oct 30 09:12:28 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:28 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:12:28 user nova-compute[75017]:       <target dev="tap834b1d2f-e0"/>
Oct 30 09:12:28 user nova-compute[75017]:     </interface>
Oct 30 09:12:28 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:12:28 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/console.log" append="off"/>
Oct 30 09:12:28 user nova-compute[75017]:     </serial>
Oct 30 09:12:28 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:12:28 user nova-compute[75017]:     <video>
Oct 30 09:12:28 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:28 user nova-compute[75017]:     </video>
Oct 30 09:12:28 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:12:28 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:12:28 user nova-compute[75017]:     </rng>
Oct 30 09:12:28 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:12:28 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:12:28 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:12:28 user nova-compute[75017]:     </memballoon>
Oct 30 09:12:28 user nova-compute[75017]:   </devices>
Oct 30 09:12:28 user nova-compute[75017]: </domain>
Oct 30 09:12:28 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-13442871',display_name='tempest-AttachVolumeNegativeTest-server-13442871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-13442871',id=2,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaBcNhxje2Oe7fvibCzJy2iyKBuqlN1rli6OhXKFDyJ5Yvc4rnmJImr4MEXarG0i1UBXEN8cpqceIsJHxOin/B0HjIbOmO3jz1EHyyrDXLIjDrHV3CElL7zwrkupJ0v4A==',key_name='tempest-keypair-501313045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-vbr7v7vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=d46e94f6-465d-4112-868e-acf8cea4f402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=834b1d2f-e0bb-4ba4-a21d-126b54f6f432,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834b1d2f-e0') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG os_vif [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=834b1d2f-e0bb-4ba4-a21d-126b54f6f432,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834b1d2f-e0') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '372a8eb2-4af9-562a-882d-8442f0dea7e7', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap834b1d2f-e0, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap834b1d2f-e0, col_values=(('qos', UUID('53696b71-9825-4604-a5ad-9b3142c44a6b')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap834b1d2f-e0, col_values=(('external_ids', {'iface-id': '834b1d2f-e0bb-4ba4-a21d-126b54f6f432', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:ef:8b', 'vm-uuid': 'd46e94f6-465d-4112-868e-acf8cea4f402'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:28 user nova-compute[75017]: INFO os_vif [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=834b1d2f-e0bb-4ba4-a21d-126b54f6f432,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834b1d2f-e0')
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No VIF found with MAC fa:16:3e:c0:ef:8b, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:12:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Instance spawned successfully.
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:28 user nova-compute[75017]: INFO nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Took 12.66 seconds to spawn the instance on the hypervisor.
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:12:28 user nova-compute[75017]: INFO nova.compute.manager [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Took 13.69 seconds to build instance.
Oct 30 09:12:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-81c30e99-1c89-4de1-8fae-b997b93b1c59 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.942s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.network.neutron [req-b4bc0ed1-70d9-458f-be91-4624ef14bece req-5f31ffb0-7b4e-439d-9ec3-814424255dd2 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Updated VIF entry in instance network info cache for port 834b1d2f-e0bb-4ba4-a21d-126b54f6f432. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG nova.network.neutron [req-b4bc0ed1-70d9-458f-be91-4624ef14bece req-5f31ffb0-7b4e-439d-9ec3-814424255dd2 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Updating instance_info_cache with network_info: [{"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4bc0ed1-70d9-458f-be91-4624ef14bece req-5f31ffb0-7b4e-439d-9ec3-814424255dd2 service nova] Releasing lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.network.neutron [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updating instance_info_cache with network_info: [{"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Releasing lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Instance network_info: |[{"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c55d22c1-0da4-47a9-bb69-55afbf2604bf req-717bf590-c430-4ea5-847e-da792847caa5 service nova] Acquired lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-c55d22c1-0da4-47a9-bb69-55afbf2604bf req-717bf590-c430-4ea5-847e-da792847caa5 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Refreshing network info cache for port 06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Start _get_guest_xml network_info=[{"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:12:29 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:29 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-237423123',display_name='tempest-ServerActionsTestOtherA-server-237423123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-237423123',id=3,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVf6zqMoogIIj/uVm0rJdIGAUOFQTJWmuf99t8ZCINTOFKb0EfkIlJX2kMG++VhQZ9/3YDSeCpCZrAjAjPqkbtlMQdQ8cwrIE78waAfMQ+vnF0Yf8L48jhmZjd9BMvMIA==',key_name='tempest-keypair-2124767111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-x1nmgmdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=35e56f63-7e8b-4324-b16c-b4fac5bb0087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:2b:90,bridge_name='br-int',has_traffic_filtering=True,id=06e70bc3-b779-49b1-be07-0e5247690823,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e70bc3-b7') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.objects.instance [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lazy-loading 'pci_devices' on Instance uuid 35e56f63-7e8b-4324-b16c-b4fac5bb0087 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:12:29 user nova-compute[75017]:   <uuid>35e56f63-7e8b-4324-b16c-b4fac5bb0087</uuid>
Oct 30 09:12:29 user nova-compute[75017]:   <name>instance-00000003</name>
Oct 30 09:12:29 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:12:29 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:12:29 user nova-compute[75017]:   <metadata>
Oct 30 09:12:29 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:12:29 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:12:29 user nova-compute[75017]:       <nova:name>tempest-ServerActionsTestOtherA-server-237423123</nova:name>
Oct 30 09:12:29 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:12:29</nova:creationTime>
Oct 30 09:12:29 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:12:29 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:12:29 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:12:29 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:12:29 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:12:29 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:12:29 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:12:29 user nova-compute[75017]:       <nova:owner>
Oct 30 09:12:29 user nova-compute[75017]:         <nova:user uuid="257ef30aa08d49a387932c340a8589c5">tempest-ServerActionsTestOtherA-1280782381-project-member</nova:user>
Oct 30 09:12:29 user nova-compute[75017]:         <nova:project uuid="f20765fc27454d25a1f53e540a8cb4fc">tempest-ServerActionsTestOtherA-1280782381</nova:project>
Oct 30 09:12:29 user nova-compute[75017]:       </nova:owner>
Oct 30 09:12:29 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:12:29 user nova-compute[75017]:       <nova:ports>
Oct 30 09:12:29 user nova-compute[75017]:         <nova:port uuid="06e70bc3-b779-49b1-be07-0e5247690823">
Oct 30 09:12:29 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 09:12:29 user nova-compute[75017]:         </nova:port>
Oct 30 09:12:29 user nova-compute[75017]:       </nova:ports>
Oct 30 09:12:29 user nova-compute[75017]:     </nova:instance>
Oct 30 09:12:29 user nova-compute[75017]:   </metadata>
Oct 30 09:12:29 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:12:29 user nova-compute[75017]:     <system>
Oct 30 09:12:29 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:12:29 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:12:29 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:12:29 user nova-compute[75017]:       <entry name="serial">35e56f63-7e8b-4324-b16c-b4fac5bb0087</entry>
Oct 30 09:12:29 user nova-compute[75017]:       <entry name="uuid">35e56f63-7e8b-4324-b16c-b4fac5bb0087</entry>
Oct 30 09:12:29 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:12:29 user nova-compute[75017]:     </system>
Oct 30 09:12:29 user nova-compute[75017]:   </sysinfo>
Oct 30 09:12:29 user nova-compute[75017]:   <os>
Oct 30 09:12:29 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:12:29 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:12:29 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:12:29 user nova-compute[75017]:   </os>
Oct 30 09:12:29 user nova-compute[75017]:   <features>
Oct 30 09:12:29 user nova-compute[75017]:     <acpi/>
Oct 30 09:12:29 user nova-compute[75017]:     <apic/>
Oct 30 09:12:29 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:12:29 user nova-compute[75017]:   </features>
Oct 30 09:12:29 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:12:29 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:12:29 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:12:29 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:12:29 user nova-compute[75017]:   </clock>
Oct 30 09:12:29 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:12:29 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:12:29 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:12:29 user nova-compute[75017]:   </cpu>
Oct 30 09:12:29 user nova-compute[75017]:   <devices>
Oct 30 09:12:29 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:12:29 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:12:29 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk"/>
Oct 30 09:12:29 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:12:29 user nova-compute[75017]:     </disk>
Oct 30 09:12:29 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:12:29 user nova-compute[75017]:       <mac address="fa:16:3e:0f:2b:90"/>
Oct 30 09:12:29 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:29 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:12:29 user nova-compute[75017]:       <target dev="tap06e70bc3-b7"/>
Oct 30 09:12:29 user nova-compute[75017]:     </interface>
Oct 30 09:12:29 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:12:29 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/console.log" append="off"/>
Oct 30 09:12:29 user nova-compute[75017]:     </serial>
Oct 30 09:12:29 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:12:29 user nova-compute[75017]:     <video>
Oct 30 09:12:29 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:29 user nova-compute[75017]:     </video>
Oct 30 09:12:29 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:12:29 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:12:29 user nova-compute[75017]:     </rng>
Oct 30 09:12:29 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:12:29 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:12:29 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:12:29 user nova-compute[75017]:     </memballoon>
Oct 30 09:12:29 user nova-compute[75017]:   </devices>
Oct 30 09:12:29 user nova-compute[75017]: </domain>
Oct 30 09:12:29 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-237423123',display_name='tempest-ServerActionsTestOtherA-server-237423123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-237423123',id=3,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVf6zqMoogIIj/uVm0rJdIGAUOFQTJWmuf99t8ZCINTOFKb0EfkIlJX2kMG++VhQZ9/3YDSeCpCZrAjAjPqkbtlMQdQ8cwrIE78waAfMQ+vnF0Yf8L48jhmZjd9BMvMIA==',key_name='tempest-keypair-2124767111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-x1nmgmdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=35e56f63-7e8b-4324-b16c-b4fac5bb0087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:2b:90,bridge_name='br-int',has_traffic_filtering=True,id=06e70bc3-b779-49b1-be07-0e5247690823,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e70bc3-b7') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG os_vif [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:2b:90,bridge_name='br-int',has_traffic_filtering=True,id=06e70bc3-b779-49b1-be07-0e5247690823,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e70bc3-b7') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe4a5a8c-c0db-5891-b682-f2c65aa9beb8', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06e70bc3-b7, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06e70bc3-b7, col_values=(('qos', UUID('620b24ff-977f-40f7-9b73-94a0275d94ae')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06e70bc3-b7, col_values=(('external_ids', {'iface-id': '06e70bc3-b779-49b1-be07-0e5247690823', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:2b:90', 'vm-uuid': '35e56f63-7e8b-4324-b16c-b4fac5bb0087'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:29 user nova-compute[75017]: INFO os_vif [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:2b:90,bridge_name='br-int',has_traffic_filtering=True,id=06e70bc3-b779-49b1-be07-0e5247690823,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e70bc3-b7')
Oct 30 09:12:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:12:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No VIF found with MAC fa:16:3e:0f:2b:90, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:12:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-c55d22c1-0da4-47a9-bb69-55afbf2604bf req-717bf590-c430-4ea5-847e-da792847caa5 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updated VIF entry in instance network info cache for port 06e70bc3-b779-49b1-be07-0e5247690823. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:12:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-c55d22c1-0da4-47a9-bb69-55afbf2604bf req-717bf590-c430-4ea5-847e-da792847caa5 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updating instance_info_cache with network_info: [{"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c55d22c1-0da4-47a9-bb69-55afbf2604bf req-717bf590-c430-4ea5-847e-da792847caa5 service nova] Releasing lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:12:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:12:33 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Instance spawned successfully.
Oct 30 09:12:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: INFO nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Took 10.76 seconds to spawn the instance on the hypervisor.
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:12:34 user nova-compute[75017]: INFO nova.compute.manager [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Took 11.92 seconds to build instance.
Oct 30 09:12:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cac74773-b0c8-4364-be2e-6946bfef0f7e tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.116s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:12:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Instance spawned successfully.
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:34 user nova-compute[75017]: INFO nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Took 10.94 seconds to spawn the instance on the hypervisor.
Oct 30 09:12:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:12:35 user nova-compute[75017]: INFO nova.compute.manager [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Took 12.26 seconds to build instance.
Oct 30 09:12:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-217b6f6f-4d11-442f-864c-d0a955b34f02 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.456s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "963c57ec-14d7-43c1-a8dc-7a062446a559" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:12:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:12:40 user nova-compute[75017]: INFO nova.compute.claims [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Claim successful on node user
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:12:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.policy [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b6b956772404d03a272335ca4d22284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afbb27caf18452f85392a059ce8e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:12:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Creating image(s)
Oct 30 09:12:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "/opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "/opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "/opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "3b6cec079a8154913073e460a656d2646d9ec5ff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "3b6cec079a8154913073e460a656d2646d9ec5ff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:41 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff.part --force-share --output=json" returned: 0 in 0.264s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG nova.virt.images [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] 01488e71-0386-4514-922a-b9f486c71d44 was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff.part /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:12:42 user nova-compute[75017]: INFO nova.compute.claims [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Claim successful on node user
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff.part /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff.converted" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff.converted --force-share --output=json" returned: 0 in 0.267s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "3b6cec079a8154913073e460a656d2646d9ec5ff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.555s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff --force-share --output=json" returned: 0 in 0.241s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "3b6cec079a8154913073e460a656d2646d9ec5ff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "3b6cec079a8154913073e460a656d2646d9ec5ff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.851s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff --force-share --output=json" returned: 0 in 0.278s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff,backing_fmt=raw /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff,backing_fmt=raw /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk 1073741824" returned: 0 in 0.108s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-526344f5-8758-44f6-8db4-e21d81e7679d req-2e475c18-2860-4fa0-96e5-4a16d6de30c6 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received event network-vif-plugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-526344f5-8758-44f6-8db4-e21d81e7679d req-2e475c18-2860-4fa0-96e5-4a16d6de30c6 service nova] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-526344f5-8758-44f6-8db4-e21d81e7679d req-2e475c18-2860-4fa0-96e5-4a16d6de30c6 service nova] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-526344f5-8758-44f6-8db4-e21d81e7679d req-2e475c18-2860-4fa0-96e5-4a16d6de30c6 service nova] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-526344f5-8758-44f6-8db4-e21d81e7679d req-2e475c18-2860-4fa0-96e5-4a16d6de30c6 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] No waiting events found dispatching network-vif-plugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:12:43 user nova-compute[75017]: WARNING nova.compute.manager [req-526344f5-8758-44f6-8db4-e21d81e7679d req-2e475c18-2860-4fa0-96e5-4a16d6de30c6 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received unexpected event network-vif-plugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 for instance with vm_state active and task_state None.
Oct 30 09:12:43 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "3b6cec079a8154913073e460a656d2646d9ec5ff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff --force-share --output=json" returned: 0 in 0.237s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Checking if we can resize image /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:12:43 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Creating image(s)
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "/opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "/opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Cannot resize image /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Ensure instance console log exists: /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.network.neutron [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Successfully created port: 5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:12:43 user nova-compute[75017]: DEBUG nova.policy [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70705b579acb43ef8420b6fa57c64e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6be03e11b42249f25e6a80223f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.328s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.208s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk 1073741824" returned: 0 in 0.124s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.243s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Cannot resize image /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Ensure instance console log exists: /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Successfully created port: f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:12:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-c5c7a628-e0cb-4af3-a0c5-cb034bfedd06 req-e3929c83-1aec-4d6d-bdea-3d8c600e2698 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received event network-vif-plugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c5c7a628-e0cb-4af3-a0c5-cb034bfedd06 req-e3929c83-1aec-4d6d-bdea-3d8c600e2698 service nova] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c5c7a628-e0cb-4af3-a0c5-cb034bfedd06 req-e3929c83-1aec-4d6d-bdea-3d8c600e2698 service nova] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c5c7a628-e0cb-4af3-a0c5-cb034bfedd06 req-e3929c83-1aec-4d6d-bdea-3d8c600e2698 service nova] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-c5c7a628-e0cb-4af3-a0c5-cb034bfedd06 req-e3929c83-1aec-4d6d-bdea-3d8c600e2698 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] No waiting events found dispatching network-vif-plugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:12:45 user nova-compute[75017]: WARNING nova.compute.manager [req-c5c7a628-e0cb-4af3-a0c5-cb034bfedd06 req-e3929c83-1aec-4d6d-bdea-3d8c600e2698 service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received unexpected event network-vif-plugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 for instance with vm_state active and task_state None.
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Successfully updated port: 5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "refresh_cache-963c57ec-14d7-43c1-a8dc-7a062446a559" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquired lock "refresh_cache-963c57ec-14d7-43c1-a8dc-7a062446a559" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Successfully updated port: f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquired lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-9cc266cb-3878-4c94-b02e-2036ac535345 req-5e04a5da-4977-413e-b5cb-6d2246891f2f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received event network-changed-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-9cc266cb-3878-4c94-b02e-2036ac535345 req-5e04a5da-4977-413e-b5cb-6d2246891f2f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Refreshing instance network info cache due to event network-changed-f159fe03-fe4c-4373-9e01-c65efbcf5c6b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9cc266cb-3878-4c94-b02e-2036ac535345 req-5e04a5da-4977-413e-b5cb-6d2246891f2f service nova] Acquiring lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Updating instance_info_cache with network_info: [{"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Releasing lock "refresh_cache-963c57ec-14d7-43c1-a8dc-7a062446a559" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Instance network_info: |[{"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Start _get_guest_xml network_info=[{"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:12:31Z,direct_url=<?>,disk_format='qcow2',id=01488e71-0386-4514-922a-b9f486c71d44,min_disk=0,min_ram=0,name='',owner='a3d3a1e8d6ff4ce8b23fadc86f860173',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:12:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/sda', 'image_id': '01488e71-0386-4514-922a-b9f486c71d44'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:12:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:12:31Z,direct_url=<?>,disk_format='qcow2',id=01488e71-0386-4514-922a-b9f486c71d44,min_disk=0,min_ram=0,name='',owner='a3d3a1e8d6ff4ce8b23fadc86f860173',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:12:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:12:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1030192591',display_name='tempest-AttachSCSIVolumeTestJSON-server-1030192591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1030192591',id=4,image_ref='01488e71-0386-4514-922a-b9f486c71d44',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxoppndYjpfZV76+RIt5RD9qLCnES/AVw3xjdHhn0qIw920w5D6+PpqpIQqaT7DnTSpOOLREvRYWbX1+7qMhhyVC0+XQjMhpAyUdSiiSrFnRjNqt2L1DH3+yKGB+yCqKQ==',key_name='tempest-keypair-1571516340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8afbb27caf18452f85392a059ce8e2ed',ramdisk_id='',reservation_id='r-0o7hvb7b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01488e71-0386-4514-922a-b9f486c71d44',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-525777381',owner_user_name='tempest-AttachSCSIVolumeTestJSON-525777381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b6b956772404d03a272335ca4d22284',uuid=963c57ec-14d7-43c1-a8dc-7a062446a559,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Converting VIF {"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:89:14,bridge_name='br-int',has_traffic_filtering=True,id=5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a,network=Network(6148b73f-e56c-4e40-aeb1-2973d55af261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdc6f86-f4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.objects.instance [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lazy-loading 'pci_devices' on Instance uuid 963c57ec-14d7-43c1-a8dc-7a062446a559 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updating instance_info_cache with network_info: [{"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:12:47 user nova-compute[75017]:   <uuid>963c57ec-14d7-43c1-a8dc-7a062446a559</uuid>
Oct 30 09:12:47 user nova-compute[75017]:   <name>instance-00000004</name>
Oct 30 09:12:47 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:12:47 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:12:47 user nova-compute[75017]:   <metadata>
Oct 30 09:12:47 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:12:47 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1030192591</nova:name>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:12:46</nova:creationTime>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:12:47 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:12:47 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:owner>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:user uuid="9b6b956772404d03a272335ca4d22284">tempest-AttachSCSIVolumeTestJSON-525777381-project-member</nova:user>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:project uuid="8afbb27caf18452f85392a059ce8e2ed">tempest-AttachSCSIVolumeTestJSON-525777381</nova:project>
Oct 30 09:12:47 user nova-compute[75017]:       </nova:owner>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:root type="image" uuid="01488e71-0386-4514-922a-b9f486c71d44"/>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:ports>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:port uuid="5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a">
Oct 30 09:12:47 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 09:12:47 user nova-compute[75017]:         </nova:port>
Oct 30 09:12:47 user nova-compute[75017]:       </nova:ports>
Oct 30 09:12:47 user nova-compute[75017]:     </nova:instance>
Oct 30 09:12:47 user nova-compute[75017]:   </metadata>
Oct 30 09:12:47 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:12:47 user nova-compute[75017]:     <system>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="serial">963c57ec-14d7-43c1-a8dc-7a062446a559</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="uuid">963c57ec-14d7-43c1-a8dc-7a062446a559</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:12:47 user nova-compute[75017]:     </system>
Oct 30 09:12:47 user nova-compute[75017]:   </sysinfo>
Oct 30 09:12:47 user nova-compute[75017]:   <os>
Oct 30 09:12:47 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:12:47 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:12:47 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:12:47 user nova-compute[75017]:   </os>
Oct 30 09:12:47 user nova-compute[75017]:   <features>
Oct 30 09:12:47 user nova-compute[75017]:     <acpi/>
Oct 30 09:12:47 user nova-compute[75017]:     <apic/>
Oct 30 09:12:47 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:12:47 user nova-compute[75017]:   </features>
Oct 30 09:12:47 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:12:47 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:12:47 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:12:47 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:12:47 user nova-compute[75017]:   </clock>
Oct 30 09:12:47 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:12:47 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:12:47 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:12:47 user nova-compute[75017]:   </cpu>
Oct 30 09:12:47 user nova-compute[75017]:   <devices>
Oct 30 09:12:47 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:12:47 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:12:47 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk"/>
Oct 30 09:12:47 user nova-compute[75017]:       <target dev="sda" bus="scsi"/>
Oct 30 09:12:47 user nova-compute[75017]:       <address type="drive" controller="0" unit="0"/>
Oct 30 09:12:47 user nova-compute[75017]:     </disk>
Oct 30 09:12:47 user nova-compute[75017]:     <disk type="file" device="cdrom">
Oct 30 09:12:47 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 09:12:47 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk.config"/>
Oct 30 09:12:47 user nova-compute[75017]:       <target dev="sdb" bus="scsi"/>
Oct 30 09:12:47 user nova-compute[75017]:       <address type="drive" controller="0" unit="1"/>
Oct 30 09:12:47 user nova-compute[75017]:     </disk>
Oct 30 09:12:47 user nova-compute[75017]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 30 09:12:47 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:12:47 user nova-compute[75017]:       <mac address="fa:16:3e:28:89:14"/>
Oct 30 09:12:47 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:47 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:12:47 user nova-compute[75017]:       <target dev="tap5cdc6f86-f4"/>
Oct 30 09:12:47 user nova-compute[75017]:     </interface>
Oct 30 09:12:47 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:12:47 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/console.log" append="off"/>
Oct 30 09:12:47 user nova-compute[75017]:     </serial>
Oct 30 09:12:47 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:12:47 user nova-compute[75017]:     <video>
Oct 30 09:12:47 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:47 user nova-compute[75017]:     </video>
Oct 30 09:12:47 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:12:47 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:12:47 user nova-compute[75017]:     </rng>
Oct 30 09:12:47 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:12:47 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:12:47 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:12:47 user nova-compute[75017]:     </memballoon>
Oct 30 09:12:47 user nova-compute[75017]:   </devices>
Oct 30 09:12:47 user nova-compute[75017]: </domain>
Oct 30 09:12:47 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1030192591',display_name='tempest-AttachSCSIVolumeTestJSON-server-1030192591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1030192591',id=4,image_ref='01488e71-0386-4514-922a-b9f486c71d44',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxoppndYjpfZV76+RIt5RD9qLCnES/AVw3xjdHhn0qIw920w5D6+PpqpIQqaT7DnTSpOOLREvRYWbX1+7qMhhyVC0+XQjMhpAyUdSiiSrFnRjNqt2L1DH3+yKGB+yCqKQ==',key_name='tempest-keypair-1571516340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8afbb27caf18452f85392a059ce8e2ed',ramdisk_id='',reservation_id='r-0o7hvb7b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01488e71-0386-4514-922a-b9f486c71d44',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-525777381',owner_user_name='tempest-AttachSCSIVolumeTestJSON-525777381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b6b956772404d03a272335ca4d22284',uuid=963c57ec-14d7-43c1-a8dc-7a062446a559,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Converting VIF {"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:89:14,bridge_name='br-int',has_traffic_filtering=True,id=5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a,network=Network(6148b73f-e56c-4e40-aeb1-2973d55af261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdc6f86-f4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG os_vif [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:89:14,bridge_name='br-int',has_traffic_filtering=True,id=5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a,network=Network(6148b73f-e56c-4e40-aeb1-2973d55af261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdc6f86-f4') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Releasing lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Instance network_info: |[{"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '259bbcd6-93fc-5688-89ff-080949924738', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9cc266cb-3878-4c94-b02e-2036ac535345 req-5e04a5da-4977-413e-b5cb-6d2246891f2f service nova] Acquired lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.neutron [req-9cc266cb-3878-4c94-b02e-2036ac535345 req-5e04a5da-4977-413e-b5cb-6d2246891f2f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Refreshing network info cache for port f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Start _get_guest_xml network_info=[{"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cdc6f86-f4, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cdc6f86-f4, col_values=(('qos', UUID('7cd143f5-fc04-4210-931c-af369c6654f1')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cdc6f86-f4, col_values=(('external_ids', {'iface-id': '5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:89:14', 'vm-uuid': '963c57ec-14d7-43c1-a8dc-7a062446a559'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: INFO os_vif [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:89:14,bridge_name='br-int',has_traffic_filtering=True,id=5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a,network=Network(6148b73f-e56c-4e40-aeb1-2973d55af261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdc6f86-f4')
Oct 30 09:12:47 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:47 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-270939356',display_name='tempest-VolumesAdminNegativeTest-server-270939356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-270939356',id=5,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHNc8rrpNEYL8lRHeX6hYYw6LKv/Zomz4CcXcw1qIO26QgHSS2jQsg+07/z7J61cxiN92ghZHYHKw03chZZKBSHxp5JF/AJw1+/seyLdui49R5J6Z5fuYjYzT7GPGawTg==',key_name='tempest-keypair-1675065355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70c6be03e11b42249f25e6a80223f16f',ramdisk_id='',reservation_id='r-jhrrql7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-790420406',owner_user_name='tempest-VolumesAdminNegativeTest-790420406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70705b579acb43ef8420b6fa57c64e12',uuid=1ce8eb40-b1ce-4b89-b19e-5d45be9687f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converting VIF {"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=f159fe03-fe4c-4373-9e01-c65efbcf5c6b,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf159fe03-fe') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:12:47 user nova-compute[75017]:   <uuid>1ce8eb40-b1ce-4b89-b19e-5d45be9687f6</uuid>
Oct 30 09:12:47 user nova-compute[75017]:   <name>instance-00000005</name>
Oct 30 09:12:47 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:12:47 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:12:47 user nova-compute[75017]:   <metadata>
Oct 30 09:12:47 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:12:47 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:name>tempest-VolumesAdminNegativeTest-server-270939356</nova:name>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:12:47</nova:creationTime>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:12:47 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:12:47 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:owner>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:user uuid="70705b579acb43ef8420b6fa57c64e12">tempest-VolumesAdminNegativeTest-790420406-project-member</nova:user>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:project uuid="70c6be03e11b42249f25e6a80223f16f">tempest-VolumesAdminNegativeTest-790420406</nova:project>
Oct 30 09:12:47 user nova-compute[75017]:       </nova:owner>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:12:47 user nova-compute[75017]:       <nova:ports>
Oct 30 09:12:47 user nova-compute[75017]:         <nova:port uuid="f159fe03-fe4c-4373-9e01-c65efbcf5c6b">
Oct 30 09:12:47 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 09:12:47 user nova-compute[75017]:         </nova:port>
Oct 30 09:12:47 user nova-compute[75017]:       </nova:ports>
Oct 30 09:12:47 user nova-compute[75017]:     </nova:instance>
Oct 30 09:12:47 user nova-compute[75017]:   </metadata>
Oct 30 09:12:47 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:12:47 user nova-compute[75017]:     <system>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="serial">1ce8eb40-b1ce-4b89-b19e-5d45be9687f6</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="uuid">1ce8eb40-b1ce-4b89-b19e-5d45be9687f6</entry>
Oct 30 09:12:47 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:12:47 user nova-compute[75017]:     </system>
Oct 30 09:12:47 user nova-compute[75017]:   </sysinfo>
Oct 30 09:12:47 user nova-compute[75017]:   <os>
Oct 30 09:12:47 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:12:47 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:12:47 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:12:47 user nova-compute[75017]:   </os>
Oct 30 09:12:47 user nova-compute[75017]:   <features>
Oct 30 09:12:47 user nova-compute[75017]:     <acpi/>
Oct 30 09:12:47 user nova-compute[75017]:     <apic/>
Oct 30 09:12:47 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:12:47 user nova-compute[75017]:   </features>
Oct 30 09:12:47 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:12:47 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:12:47 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:12:47 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:12:47 user nova-compute[75017]:   </clock>
Oct 30 09:12:47 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:12:47 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:12:47 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:12:47 user nova-compute[75017]:   </cpu>
Oct 30 09:12:47 user nova-compute[75017]:   <devices>
Oct 30 09:12:47 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:12:47 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:12:47 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk"/>
Oct 30 09:12:47 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:12:47 user nova-compute[75017]:     </disk>
Oct 30 09:12:47 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:12:47 user nova-compute[75017]:       <mac address="fa:16:3e:00:96:2d"/>
Oct 30 09:12:47 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:47 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:12:47 user nova-compute[75017]:       <target dev="tapf159fe03-fe"/>
Oct 30 09:12:47 user nova-compute[75017]:     </interface>
Oct 30 09:12:47 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:12:47 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/console.log" append="off"/>
Oct 30 09:12:47 user nova-compute[75017]:     </serial>
Oct 30 09:12:47 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:12:47 user nova-compute[75017]:     <video>
Oct 30 09:12:47 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:47 user nova-compute[75017]:     </video>
Oct 30 09:12:47 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:12:47 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:12:47 user nova-compute[75017]:     </rng>
Oct 30 09:12:47 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:12:47 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:12:47 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:12:47 user nova-compute[75017]:     </memballoon>
Oct 30 09:12:47 user nova-compute[75017]:   </devices>
Oct 30 09:12:47 user nova-compute[75017]: </domain>
Oct 30 09:12:47 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-270939356',display_name='tempest-VolumesAdminNegativeTest-server-270939356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-270939356',id=5,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHNc8rrpNEYL8lRHeX6hYYw6LKv/Zomz4CcXcw1qIO26QgHSS2jQsg+07/z7J61cxiN92ghZHYHKw03chZZKBSHxp5JF/AJw1+/seyLdui49R5J6Z5fuYjYzT7GPGawTg==',key_name='tempest-keypair-1675065355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70c6be03e11b42249f25e6a80223f16f',ramdisk_id='',reservation_id='r-jhrrql7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-790420406',owner_user_name='tempest-VolumesAdminNegativeTest-790420406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70705b579acb43ef8420b6fa57c64e12',uuid=1ce8eb40-b1ce-4b89-b19e-5d45be9687f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converting VIF {"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=f159fe03-fe4c-4373-9e01-c65efbcf5c6b,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf159fe03-fe') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG os_vif [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=f159fe03-fe4c-4373-9e01-c65efbcf5c6b,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf159fe03-fe') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4ff291d-a649-5ca7-b2d0-c754e75c990c', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf159fe03-fe, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf159fe03-fe, col_values=(('qos', UUID('82ddafa9-2499-42c0-bb25-cc8ca21c60a4')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf159fe03-fe, col_values=(('external_ids', {'iface-id': 'f159fe03-fe4c-4373-9e01-c65efbcf5c6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:96:2d', 'vm-uuid': '1ce8eb40-b1ce-4b89-b19e-5d45be9687f6'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] No BDM found with device name sda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] No VIF found with MAC fa:16:3e:28:89:14, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:12:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Using config drive
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: INFO os_vif [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=f159fe03-fe4c-4373-9e01-c65efbcf5c6b,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf159fe03-fe')
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] No VIF found with MAC fa:16:3e:00:96:2d, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-7568d5fa-43b0-405b-8bd3-67a3d0149578 req-ea9e8cea-cf34-472b-9772-403a38ffcce0 service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Received event network-changed-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-7568d5fa-43b0-405b-8bd3-67a3d0149578 req-ea9e8cea-cf34-472b-9772-403a38ffcce0 service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Refreshing instance network info cache due to event network-changed-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7568d5fa-43b0-405b-8bd3-67a3d0149578 req-ea9e8cea-cf34-472b-9772-403a38ffcce0 service nova] Acquiring lock "refresh_cache-963c57ec-14d7-43c1-a8dc-7a062446a559" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7568d5fa-43b0-405b-8bd3-67a3d0149578 req-ea9e8cea-cf34-472b-9772-403a38ffcce0 service nova] Acquired lock "refresh_cache-963c57ec-14d7-43c1-a8dc-7a062446a559" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:47 user nova-compute[75017]: DEBUG nova.network.neutron [req-7568d5fa-43b0-405b-8bd3-67a3d0149578 req-ea9e8cea-cf34-472b-9772-403a38ffcce0 service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Refreshing network info cache for port 5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:12:48 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Creating config drive at /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk.config
Oct 30 09:12:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy314sz1w {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy314sz1w" returned: 0 in 0.074s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:48 user nova-compute[75017]: DEBUG nova.network.neutron [req-9cc266cb-3878-4c94-b02e-2036ac535345 req-5e04a5da-4977-413e-b5cb-6d2246891f2f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updated VIF entry in instance network info cache for port f159fe03-fe4c-4373-9e01-c65efbcf5c6b. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:12:48 user nova-compute[75017]: DEBUG nova.network.neutron [req-9cc266cb-3878-4c94-b02e-2036ac535345 req-5e04a5da-4977-413e-b5cb-6d2246891f2f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updating instance_info_cache with network_info: [{"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:48 user nova-compute[75017]: DEBUG nova.network.neutron [req-7568d5fa-43b0-405b-8bd3-67a3d0149578 req-ea9e8cea-cf34-472b-9772-403a38ffcce0 service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Updated VIF entry in instance network info cache for port 5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:12:48 user nova-compute[75017]: DEBUG nova.network.neutron [req-7568d5fa-43b0-405b-8bd3-67a3d0149578 req-ea9e8cea-cf34-472b-9772-403a38ffcce0 service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Updating instance_info_cache with network_info: [{"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9cc266cb-3878-4c94-b02e-2036ac535345 req-5e04a5da-4977-413e-b5cb-6d2246891f2f service nova] Releasing lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7568d5fa-43b0-405b-8bd3-67a3d0149578 req-ea9e8cea-cf34-472b-9772-403a38ffcce0 service nova] Releasing lock "refresh_cache-963c57ec-14d7-43c1-a8dc-7a062446a559" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-5c33706b-0ca5-4909-9cf9-3bf418d17f8c req-9e2e32b5-885d-47ad-91a6-2e4225ffc82c service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received event network-vif-plugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5c33706b-0ca5-4909-9cf9-3bf418d17f8c req-9e2e32b5-885d-47ad-91a6-2e4225ffc82c service nova] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5c33706b-0ca5-4909-9cf9-3bf418d17f8c req-9e2e32b5-885d-47ad-91a6-2e4225ffc82c service nova] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5c33706b-0ca5-4909-9cf9-3bf418d17f8c req-9e2e32b5-885d-47ad-91a6-2e4225ffc82c service nova] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-5c33706b-0ca5-4909-9cf9-3bf418d17f8c req-9e2e32b5-885d-47ad-91a6-2e4225ffc82c service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] No waiting events found dispatching network-vif-plugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:12:50 user nova-compute[75017]: WARNING nova.compute.manager [req-5c33706b-0ca5-4909-9cf9-3bf418d17f8c req-9e2e32b5-885d-47ad-91a6-2e4225ffc82c service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received unexpected event network-vif-plugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b for instance with vm_state building and task_state spawning.
Oct 30 09:12:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:12:51 user nova-compute[75017]: INFO nova.compute.claims [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Claim successful on node user
Oct 30 09:12:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:51 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-9ffc2d05-b1e3-4a54-be05-c21d0c82dca9 req-ef1c1880-30dd-4687-8096-3ab2216e3d4c service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received event network-vif-plugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9ffc2d05-b1e3-4a54-be05-c21d0c82dca9 req-ef1c1880-30dd-4687-8096-3ab2216e3d4c service nova] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9ffc2d05-b1e3-4a54-be05-c21d0c82dca9 req-ef1c1880-30dd-4687-8096-3ab2216e3d4c service nova] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9ffc2d05-b1e3-4a54-be05-c21d0c82dca9 req-ef1c1880-30dd-4687-8096-3ab2216e3d4c service nova] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-9ffc2d05-b1e3-4a54-be05-c21d0c82dca9 req-ef1c1880-30dd-4687-8096-3ab2216e3d4c service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] No waiting events found dispatching network-vif-plugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:12:52 user nova-compute[75017]: WARNING nova.compute.manager [req-9ffc2d05-b1e3-4a54-be05-c21d0c82dca9 req-ef1c1880-30dd-4687-8096-3ab2216e3d4c service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received unexpected event network-vif-plugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b for instance with vm_state building and task_state spawning.
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.464s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:12:52 user nova-compute[75017]: INFO nova.compute.claims [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Claim successful on node user
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:12:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.policy [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd07d295a1ae406eb356f64c61bcfff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1013afec1974848b3a4c434e78cc849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:12:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Creating image(s)
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "/opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "/opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "/opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:12:52 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.228s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:12:53 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.policy [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72543d1c58b7444aa36e252b59f33625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbfa2cb0b7e442eb6a91f94df21dbe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:12:53 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Creating image(s)
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk 1073741824" returned: 0 in 0.104s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:12:53 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Instance spawned successfully.
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:12:53 user nova-compute[75017]: INFO nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Took 9.96 seconds to spawn the instance on the hypervisor.
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Successfully created port: f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:12:53 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Instance spawned successfully.
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:12:53 user nova-compute[75017]: INFO nova.compute.manager [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Took 11.71 seconds to build instance.
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5698fb4f-478e-40a8-a405-051aaf214a0f tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.885s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Cannot resize image /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Ensure instance console log exists: /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:53 user nova-compute[75017]: INFO nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Took 12.87 seconds to spawn the instance on the hypervisor.
Oct 30 09:12:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk 1073741824" returned: 0 in 0.089s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:54 user nova-compute[75017]: INFO nova.compute.manager [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Took 14.09 seconds to build instance.
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Successfully created port: 840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-acffabcd-55f0-4958-99da-56fd6f0c01c3 tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.287s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.246s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Cannot resize image /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Ensure instance console log exists: /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Successfully updated port: f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquired lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Successfully updated port: 840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquired lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-9472759d-2942-4eb2-9eb3-b299bb346716 req-cbd82950-b8d2-430d-9e49-1cd2e87da9fa service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-changed-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-9472759d-2942-4eb2-9eb3-b299bb346716 req-cbd82950-b8d2-430d-9e49-1cd2e87da9fa service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Refreshing instance network info cache due to event network-changed-840e6749-42d0-4bb0-9787-a348ca450fe7. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9472759d-2942-4eb2-9eb3-b299bb346716 req-cbd82950-b8d2-430d-9e49-1cd2e87da9fa service nova] Acquiring lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:12:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.compute.manager [req-d2d7e012-e548-4b70-8371-7786c96fcb08 req-51a748ad-fb46-47f7-9a5d-8bd905650b37 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received event network-changed-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.compute.manager [req-d2d7e012-e548-4b70-8371-7786c96fcb08 req-51a748ad-fb46-47f7-9a5d-8bd905650b37 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Refreshing instance network info cache due to event network-changed-f928f8ba-850a-4a21-8553-ab2c3860c8a7. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d2d7e012-e548-4b70-8371-7786c96fcb08 req-51a748ad-fb46-47f7-9a5d-8bd905650b37 service nova] Acquiring lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updating instance_info_cache with network_info: [{"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Releasing lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Instance network_info: |[{"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9472759d-2942-4eb2-9eb3-b299bb346716 req-cbd82950-b8d2-430d-9e49-1cd2e87da9fa service nova] Acquired lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.neutron [req-9472759d-2942-4eb2-9eb3-b299bb346716 req-cbd82950-b8d2-430d-9e49-1cd2e87da9fa service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Refreshing network info cache for port 840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Start _get_guest_xml network_info=[{"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:12:55 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:55 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-57449668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-57449668',id=7,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISm4h9XE1KNjZ2BtaUqmuhfL1YRvfcyLbox2ZePi/EII8ogZ6S4AfZo+/2Z52igxxz2fW/Rx2pXwsmh/8mnYbXpfRpgYHTdJLGwxN4G2z5fHYm02Wr1qLrrUa0GrO3NaQ==',key_name='tempest-keypair-1815186852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cbfa2cb0b7e442eb6a91f94df21dbe0',ramdisk_id='',reservation_id='r-zhoyj2oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2138896194',owner_user_name='tempest-TaggedAttachmentsTest-2138896194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72543d1c58b7444aa36e252b59f33625',uuid=17969235-fc8b-4b25-995b-fdce8b496974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converting VIF {"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:f7,bridge_name='br-int',has_traffic_filtering=True,id=840e6749-42d0-4bb0-9787-a348ca450fe7,network=Network(ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840e6749-42') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lazy-loading 'pci_devices' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Updating instance_info_cache with network_info: [{"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:12:55 user nova-compute[75017]:   <uuid>17969235-fc8b-4b25-995b-fdce8b496974</uuid>
Oct 30 09:12:55 user nova-compute[75017]:   <name>instance-00000007</name>
Oct 30 09:12:55 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:12:55 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:12:55 user nova-compute[75017]:   <metadata>
Oct 30 09:12:55 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:12:55 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:name>tempest-device-tagging-server-57449668</nova:name>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:12:55</nova:creationTime>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:12:55 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:12:55 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:owner>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:user uuid="72543d1c58b7444aa36e252b59f33625">tempest-TaggedAttachmentsTest-2138896194-project-member</nova:user>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:project uuid="2cbfa2cb0b7e442eb6a91f94df21dbe0">tempest-TaggedAttachmentsTest-2138896194</nova:project>
Oct 30 09:12:55 user nova-compute[75017]:       </nova:owner>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:ports>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:port uuid="840e6749-42d0-4bb0-9787-a348ca450fe7">
Oct 30 09:12:55 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:12:55 user nova-compute[75017]:         </nova:port>
Oct 30 09:12:55 user nova-compute[75017]:       </nova:ports>
Oct 30 09:12:55 user nova-compute[75017]:     </nova:instance>
Oct 30 09:12:55 user nova-compute[75017]:   </metadata>
Oct 30 09:12:55 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:12:55 user nova-compute[75017]:     <system>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="serial">17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="uuid">17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:12:55 user nova-compute[75017]:     </system>
Oct 30 09:12:55 user nova-compute[75017]:   </sysinfo>
Oct 30 09:12:55 user nova-compute[75017]:   <os>
Oct 30 09:12:55 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:12:55 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:12:55 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:12:55 user nova-compute[75017]:   </os>
Oct 30 09:12:55 user nova-compute[75017]:   <features>
Oct 30 09:12:55 user nova-compute[75017]:     <acpi/>
Oct 30 09:12:55 user nova-compute[75017]:     <apic/>
Oct 30 09:12:55 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:12:55 user nova-compute[75017]:   </features>
Oct 30 09:12:55 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:12:55 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:12:55 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:12:55 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:12:55 user nova-compute[75017]:   </clock>
Oct 30 09:12:55 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:12:55 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:12:55 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:12:55 user nova-compute[75017]:   </cpu>
Oct 30 09:12:55 user nova-compute[75017]:   <devices>
Oct 30 09:12:55 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:12:55 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:12:55 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk"/>
Oct 30 09:12:55 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:12:55 user nova-compute[75017]:     </disk>
Oct 30 09:12:55 user nova-compute[75017]:     <disk type="file" device="cdrom">
Oct 30 09:12:55 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 09:12:55 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.config"/>
Oct 30 09:12:55 user nova-compute[75017]:       <target dev="hda" bus="ide"/>
Oct 30 09:12:55 user nova-compute[75017]:     </disk>
Oct 30 09:12:55 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:12:55 user nova-compute[75017]:       <mac address="fa:16:3e:3a:5d:f7"/>
Oct 30 09:12:55 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:55 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:12:55 user nova-compute[75017]:       <target dev="tap840e6749-42"/>
Oct 30 09:12:55 user nova-compute[75017]:     </interface>
Oct 30 09:12:55 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:12:55 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log" append="off"/>
Oct 30 09:12:55 user nova-compute[75017]:     </serial>
Oct 30 09:12:55 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:12:55 user nova-compute[75017]:     <video>
Oct 30 09:12:55 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:55 user nova-compute[75017]:     </video>
Oct 30 09:12:55 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:12:55 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:12:55 user nova-compute[75017]:     </rng>
Oct 30 09:12:55 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:12:55 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:12:55 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:12:55 user nova-compute[75017]:     </memballoon>
Oct 30 09:12:55 user nova-compute[75017]:   </devices>
Oct 30 09:12:55 user nova-compute[75017]: </domain>
Oct 30 09:12:55 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-57449668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-57449668',id=7,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISm4h9XE1KNjZ2BtaUqmuhfL1YRvfcyLbox2ZePi/EII8ogZ6S4AfZo+/2Z52igxxz2fW/Rx2pXwsmh/8mnYbXpfRpgYHTdJLGwxN4G2z5fHYm02Wr1qLrrUa0GrO3NaQ==',key_name='tempest-keypair-1815186852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cbfa2cb0b7e442eb6a91f94df21dbe0',ramdisk_id='',reservation_id='r-zhoyj2oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2138896194',owner_user_name='tempest-TaggedAttachmentsTest-2138896194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72543d1c58b7444aa36e252b59f33625',uuid=17969235-fc8b-4b25-995b-fdce8b496974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converting VIF {"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:f7,bridge_name='br-int',has_traffic_filtering=True,id=840e6749-42d0-4bb0-9787-a348ca450fe7,network=Network(ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840e6749-42') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG os_vif [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:f7,bridge_name='br-int',has_traffic_filtering=True,id=840e6749-42d0-4bb0-9787-a348ca450fe7,network=Network(ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840e6749-42') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Releasing lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Instance network_info: |[{"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ec27534-9e4b-5b9b-8eea-0f65d25f88c9', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d2d7e012-e548-4b70-8371-7786c96fcb08 req-51a748ad-fb46-47f7-9a5d-8bd905650b37 service nova] Acquired lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.neutron [req-d2d7e012-e548-4b70-8371-7786c96fcb08 req-51a748ad-fb46-47f7-9a5d-8bd905650b37 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Refreshing network info cache for port f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Start _get_guest_xml network_info=[{"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap840e6749-42, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap840e6749-42, col_values=(('qos', UUID('706ccc44-634e-4366-858f-9551821ab979')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap840e6749-42, col_values=(('external_ids', {'iface-id': '840e6749-42d0-4bb0-9787-a348ca450fe7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:5d:f7', 'vm-uuid': '17969235-fc8b-4b25-995b-fdce8b496974'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:55 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:55 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:12:55 user nova-compute[75017]: INFO os_vif [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:f7,bridge_name='br-int',has_traffic_filtering=True,id=840e6749-42d0-4bb0-9787-a348ca450fe7,network=Network(ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840e6749-42')
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1111762858',display_name='tempest-TestVolumeSwap-server-1111762858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1111762858',id=6,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7NI+kWi01jDLCAbpwU0SRvzJP853am//78+XkNM/J9TPaDGVIZwtvIWEFjaiEwNOt9JCyjzz1iNk/D814nevjlSi8YTmA5KlL/OpWu30jGjzLEtwQEp3LKrdu0xctoYA==',key_name='tempest-keypair-90741168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1013afec1974848b3a4c434e78cc849',ramdisk_id='',reservation_id='r-rq0de9jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-144653908',owner_user_name='tempest-TestVolumeSwap-144653908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd07d295a1ae406eb356f64c61bcfff2',uuid=df215875-673c-4446-afa1-3446ff63edbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Converting VIF {"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:80:5f,bridge_name='br-int',has_traffic_filtering=True,id=f928f8ba-850a-4a21-8553-ab2c3860c8a7,network=Network(61f27ddb-61b1-4856-ac74-4bfecf906272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf928f8ba-85') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.objects.instance [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lazy-loading 'pci_devices' on Instance uuid df215875-673c-4446-afa1-3446ff63edbd {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:12:55 user nova-compute[75017]:   <uuid>df215875-673c-4446-afa1-3446ff63edbd</uuid>
Oct 30 09:12:55 user nova-compute[75017]:   <name>instance-00000006</name>
Oct 30 09:12:55 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:12:55 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:12:55 user nova-compute[75017]:   <metadata>
Oct 30 09:12:55 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:12:55 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:name>tempest-TestVolumeSwap-server-1111762858</nova:name>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:12:55</nova:creationTime>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:12:55 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:12:55 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:owner>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:user uuid="cd07d295a1ae406eb356f64c61bcfff2">tempest-TestVolumeSwap-144653908-project-member</nova:user>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:project uuid="e1013afec1974848b3a4c434e78cc849">tempest-TestVolumeSwap-144653908</nova:project>
Oct 30 09:12:55 user nova-compute[75017]:       </nova:owner>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:12:55 user nova-compute[75017]:       <nova:ports>
Oct 30 09:12:55 user nova-compute[75017]:         <nova:port uuid="f928f8ba-850a-4a21-8553-ab2c3860c8a7">
Oct 30 09:12:55 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 09:12:55 user nova-compute[75017]:         </nova:port>
Oct 30 09:12:55 user nova-compute[75017]:       </nova:ports>
Oct 30 09:12:55 user nova-compute[75017]:     </nova:instance>
Oct 30 09:12:55 user nova-compute[75017]:   </metadata>
Oct 30 09:12:55 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:12:55 user nova-compute[75017]:     <system>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="serial">df215875-673c-4446-afa1-3446ff63edbd</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="uuid">df215875-673c-4446-afa1-3446ff63edbd</entry>
Oct 30 09:12:55 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:12:55 user nova-compute[75017]:     </system>
Oct 30 09:12:55 user nova-compute[75017]:   </sysinfo>
Oct 30 09:12:55 user nova-compute[75017]:   <os>
Oct 30 09:12:55 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:12:55 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:12:55 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:12:55 user nova-compute[75017]:   </os>
Oct 30 09:12:55 user nova-compute[75017]:   <features>
Oct 30 09:12:55 user nova-compute[75017]:     <acpi/>
Oct 30 09:12:55 user nova-compute[75017]:     <apic/>
Oct 30 09:12:55 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:12:55 user nova-compute[75017]:   </features>
Oct 30 09:12:55 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:12:55 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:12:55 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:12:55 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:12:55 user nova-compute[75017]:   </clock>
Oct 30 09:12:55 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:12:55 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:12:55 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:12:55 user nova-compute[75017]:   </cpu>
Oct 30 09:12:55 user nova-compute[75017]:   <devices>
Oct 30 09:12:55 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:12:55 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:12:55 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk"/>
Oct 30 09:12:55 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:12:55 user nova-compute[75017]:     </disk>
Oct 30 09:12:55 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:12:55 user nova-compute[75017]:       <mac address="fa:16:3e:e7:80:5f"/>
Oct 30 09:12:55 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:55 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:12:55 user nova-compute[75017]:       <target dev="tapf928f8ba-85"/>
Oct 30 09:12:55 user nova-compute[75017]:     </interface>
Oct 30 09:12:55 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:12:55 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/console.log" append="off"/>
Oct 30 09:12:55 user nova-compute[75017]:     </serial>
Oct 30 09:12:55 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:12:55 user nova-compute[75017]:     <video>
Oct 30 09:12:55 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:12:55 user nova-compute[75017]:     </video>
Oct 30 09:12:55 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:12:55 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:12:55 user nova-compute[75017]:     </rng>
Oct 30 09:12:55 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:12:55 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:12:55 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:12:55 user nova-compute[75017]:     </memballoon>
Oct 30 09:12:55 user nova-compute[75017]:   </devices>
Oct 30 09:12:55 user nova-compute[75017]: </domain>
Oct 30 09:12:55 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1111762858',display_name='tempest-TestVolumeSwap-server-1111762858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1111762858',id=6,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7NI+kWi01jDLCAbpwU0SRvzJP853am//78+XkNM/J9TPaDGVIZwtvIWEFjaiEwNOt9JCyjzz1iNk/D814nevjlSi8YTmA5KlL/OpWu30jGjzLEtwQEp3LKrdu0xctoYA==',key_name='tempest-keypair-90741168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1013afec1974848b3a4c434e78cc849',ramdisk_id='',reservation_id='r-rq0de9jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-144653908',owner_user_name='tempest-TestVolumeSwap-144653908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd07d295a1ae406eb356f64c61bcfff2',uuid=df215875-673c-4446-afa1-3446ff63edbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Converting VIF {"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:80:5f,bridge_name='br-int',has_traffic_filtering=True,id=f928f8ba-850a-4a21-8553-ab2c3860c8a7,network=Network(61f27ddb-61b1-4856-ac74-4bfecf906272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf928f8ba-85') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG os_vif [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:80:5f,bridge_name='br-int',has_traffic_filtering=True,id=f928f8ba-850a-4a21-8553-ab2c3860c8a7,network=Network(61f27ddb-61b1-4856-ac74-4bfecf906272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf928f8ba-85') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1493650c-d984-5314-88ac-93860c417b04', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf928f8ba-85, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf928f8ba-85, col_values=(('qos', UUID('1572f167-1f55-4d5f-882f-edf951d03e35')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf928f8ba-85, col_values=(('external_ids', {'iface-id': 'f928f8ba-850a-4a21-8553-ab2c3860c8a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:80:5f', 'vm-uuid': 'df215875-673c-4446-afa1-3446ff63edbd'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:55 user nova-compute[75017]: INFO os_vif [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:80:5f,bridge_name='br-int',has_traffic_filtering=True,id=f928f8ba-850a-4a21-8553-ab2c3860c8a7,network=Network(61f27ddb-61b1-4856-ac74-4bfecf906272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf928f8ba-85')
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] No BDM found with device name hda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] No VIF found with MAC fa:16:3e:3a:5d:f7, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:12:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Using config drive
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:12:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] No VIF found with MAC fa:16:3e:e7:80:5f, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:12:56 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Creating config drive at /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.config
Oct 30 09:12:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp26c_liww {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:12:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp26c_liww" returned: 0 in 0.057s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:12:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-9472759d-2942-4eb2-9eb3-b299bb346716 req-cbd82950-b8d2-430d-9e49-1cd2e87da9fa service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updated VIF entry in instance network info cache for port 840e6749-42d0-4bb0-9787-a348ca450fe7. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:12:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-9472759d-2942-4eb2-9eb3-b299bb346716 req-cbd82950-b8d2-430d-9e49-1cd2e87da9fa service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updating instance_info_cache with network_info: [{"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9472759d-2942-4eb2-9eb3-b299bb346716 req-cbd82950-b8d2-430d-9e49-1cd2e87da9fa service nova] Releasing lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-d2d7e012-e548-4b70-8371-7786c96fcb08 req-51a748ad-fb46-47f7-9a5d-8bd905650b37 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Updated VIF entry in instance network info cache for port f928f8ba-850a-4a21-8553-ab2c3860c8a7. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:12:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-d2d7e012-e548-4b70-8371-7786c96fcb08 req-51a748ad-fb46-47f7-9a5d-8bd905650b37 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Updating instance_info_cache with network_info: [{"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:12:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d2d7e012-e548-4b70-8371-7786c96fcb08 req-51a748ad-fb46-47f7-9a5d-8bd905650b37 service nova] Releasing lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:12:58 user nova-compute[75017]: INFO nova.compute.claims [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Claim successful on node user
Oct 30 09:12:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2c3f04b-59c8-4f5e-a776-7a39ef1bc98b req-db2c1b69-1df2-4d91-b805-678bb6a9320f service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received event network-vif-plugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2c3f04b-59c8-4f5e-a776-7a39ef1bc98b req-db2c1b69-1df2-4d91-b805-678bb6a9320f service nova] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2c3f04b-59c8-4f5e-a776-7a39ef1bc98b req-db2c1b69-1df2-4d91-b805-678bb6a9320f service nova] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2c3f04b-59c8-4f5e-a776-7a39ef1bc98b req-db2c1b69-1df2-4d91-b805-678bb6a9320f service nova] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2c3f04b-59c8-4f5e-a776-7a39ef1bc98b req-db2c1b69-1df2-4d91-b805-678bb6a9320f service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] No waiting events found dispatching network-vif-plugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:12:58 user nova-compute[75017]: WARNING nova.compute.manager [req-e2c3f04b-59c8-4f5e-a776-7a39ef1bc98b req-db2c1b69-1df2-4d91-b805-678bb6a9320f service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received unexpected event network-vif-plugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 for instance with vm_state building and task_state spawning.
Oct 30 09:12:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG nova.network.neutron [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:12:59 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:12:59 user nova-compute[75017]: DEBUG nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG nova.policy [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23cd27d764e549da8d31f2061e0be75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293b9d9e7684474808321a8327d8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:12:59 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Creating image(s)
Oct 30 09:12:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquiring lock "/opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "/opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "/opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:12:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.305s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.247s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk 1073741824" returned: 0 in 0.071s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.259s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:00 user nova-compute[75017]: DEBUG nova.network.neutron [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Successfully created port: 206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received event network-vif-plugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] No waiting events found dispatching network-vif-plugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:01 user nova-compute[75017]: WARNING nova.compute.manager [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received unexpected event network-vif-plugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 for instance with vm_state building and task_state spawning.
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-plugged-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] No waiting events found dispatching network-vif-plugged-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:01 user nova-compute[75017]: WARNING nova.compute.manager [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received unexpected event network-vif-plugged-840e6749-42d0-4bb0-9787-a348ca450fe7 for instance with vm_state building and task_state spawning.
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-plugged-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] No waiting events found dispatching network-vif-plugged-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:01 user nova-compute[75017]: WARNING nova.compute.manager [req-93065cb2-a578-4374-8b98-d92ad778b716 req-c5e76c04-bf03-4bf7-b628-d5f7f05fd0f7 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received unexpected event network-vif-plugged-840e6749-42d0-4bb0-9787-a348ca450fe7 for instance with vm_state building and task_state spawning.
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Cannot resize image /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Ensure instance console log exists: /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-4e106e76-d3a9-44bb-9925-e2c3504a82df req-7676c351-d80f-4fb5-91ac-6ad2eec93cc2 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received event network-vif-plugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4e106e76-d3a9-44bb-9925-e2c3504a82df req-7676c351-d80f-4fb5-91ac-6ad2eec93cc2 service nova] Acquiring lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4e106e76-d3a9-44bb-9925-e2c3504a82df req-7676c351-d80f-4fb5-91ac-6ad2eec93cc2 service nova] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4e106e76-d3a9-44bb-9925-e2c3504a82df req-7676c351-d80f-4fb5-91ac-6ad2eec93cc2 service nova] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-4e106e76-d3a9-44bb-9925-e2c3504a82df req-7676c351-d80f-4fb5-91ac-6ad2eec93cc2 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] No waiting events found dispatching network-vif-plugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:01 user nova-compute[75017]: WARNING nova.compute.manager [req-4e106e76-d3a9-44bb-9925-e2c3504a82df req-7676c351-d80f-4fb5-91ac-6ad2eec93cc2 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received unexpected event network-vif-plugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f for instance with vm_state active and task_state None.
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.network.neutron [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Successfully updated port: 206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquiring lock "refresh_cache-32e25927-79c3-490f-b53a-03d4a6299e42" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquired lock "refresh_cache-32e25927-79c3-490f-b53a-03d4a6299e42" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.network.neutron [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-d8b4a240-f4bc-4b4f-ae3b-04aafb55acfc req-b35fc153-35ff-4f64-ac2e-d6a7772afa7c service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received event network-changed-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-d8b4a240-f4bc-4b4f-ae3b-04aafb55acfc req-b35fc153-35ff-4f64-ac2e-d6a7772afa7c service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Refreshing instance network info cache due to event network-changed-206f4965-cf18-4bb3-a500-f5190b3ef833. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d8b4a240-f4bc-4b4f-ae3b-04aafb55acfc req-b35fc153-35ff-4f64-ac2e-d6a7772afa7c service nova] Acquiring lock "refresh_cache-32e25927-79c3-490f-b53a-03d4a6299e42" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:13:01 user nova-compute[75017]: DEBUG nova.network.neutron [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:13:02 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Instance spawned successfully.
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:13:02 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: df215875-673c-4446-afa1-3446ff63edbd] Instance spawned successfully.
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:02 user nova-compute[75017]: INFO nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Took 9.39 seconds to spawn the instance on the hypervisor.
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:13:02 user nova-compute[75017]: INFO nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Took 8.92 seconds to spawn the instance on the hypervisor.
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:13:02 user nova-compute[75017]: INFO nova.compute.manager [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Took 10.43 seconds to build instance.
Oct 30 09:13:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cd726156-3445-4db4-bc7d-ec5e27eab3c3 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.601s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.network.neutron [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Updating instance_info_cache with network_info: [{"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:13:02 user nova-compute[75017]: INFO nova.compute.manager [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Took 10.28 seconds to build instance.
Oct 30 09:13:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5859f07f-5be4-4c40-b7f6-4afd336216bc tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.394s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Releasing lock "refresh_cache-32e25927-79c3-490f-b53a-03d4a6299e42" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Instance network_info: |[{"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d8b4a240-f4bc-4b4f-ae3b-04aafb55acfc req-b35fc153-35ff-4f64-ac2e-d6a7772afa7c service nova] Acquired lock "refresh_cache-32e25927-79c3-490f-b53a-03d4a6299e42" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.network.neutron [req-d8b4a240-f4bc-4b4f-ae3b-04aafb55acfc req-b35fc153-35ff-4f64-ac2e-d6a7772afa7c service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Refreshing network info cache for port 206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Start _get_guest_xml network_info=[{"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:13:02 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:13:02 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-980255719',display_name='tempest-VolumesAssistedSnapshotsTest-server-980255719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-980255719',id=8,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiniJ6k7LE2AC+XrNeRBK1F5zsv44UUAxUVO4FOXGxcJjFnrLdNzviWVrW1CbwY8iMnqocbYt3O+pAx47+KUnU0u4aQQnMsdOQ9WBbmwx0iLvrFTeZOfcktyEXH+QiYmg==',key_name='tempest-keypair-625456945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0293b9d9e7684474808321a8327d8338',ramdisk_id='',reservation_id='r-0xm1wm8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-221021361',owner_user_name='tempest-VolumesAssistedSnapshotsTest-221021361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23cd27d764e549da8d31f2061e0be75d',uuid=32e25927-79c3-490f-b53a-03d4a6299e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Converting VIF {"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=206f4965-cf18-4bb3-a500-f5190b3ef833,network=Network(340760f9-8f2b-4382-a61d-882225c35454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206f4965-cf') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lazy-loading 'pci_devices' on Instance uuid 32e25927-79c3-490f-b53a-03d4a6299e42 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:13:02 user nova-compute[75017]:   <uuid>32e25927-79c3-490f-b53a-03d4a6299e42</uuid>
Oct 30 09:13:02 user nova-compute[75017]:   <name>instance-00000008</name>
Oct 30 09:13:02 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:13:02 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:13:02 user nova-compute[75017]:   <metadata>
Oct 30 09:13:02 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:13:02 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:13:02 user nova-compute[75017]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-980255719</nova:name>
Oct 30 09:13:02 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:13:02</nova:creationTime>
Oct 30 09:13:02 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:13:02 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:13:02 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:13:02 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:13:02 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:13:02 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:13:02 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:13:02 user nova-compute[75017]:       <nova:owner>
Oct 30 09:13:02 user nova-compute[75017]:         <nova:user uuid="23cd27d764e549da8d31f2061e0be75d">tempest-VolumesAssistedSnapshotsTest-221021361-project-member</nova:user>
Oct 30 09:13:02 user nova-compute[75017]:         <nova:project uuid="0293b9d9e7684474808321a8327d8338">tempest-VolumesAssistedSnapshotsTest-221021361</nova:project>
Oct 30 09:13:02 user nova-compute[75017]:       </nova:owner>
Oct 30 09:13:02 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:13:02 user nova-compute[75017]:       <nova:ports>
Oct 30 09:13:02 user nova-compute[75017]:         <nova:port uuid="206f4965-cf18-4bb3-a500-f5190b3ef833">
Oct 30 09:13:02 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:13:02 user nova-compute[75017]:         </nova:port>
Oct 30 09:13:02 user nova-compute[75017]:       </nova:ports>
Oct 30 09:13:02 user nova-compute[75017]:     </nova:instance>
Oct 30 09:13:02 user nova-compute[75017]:   </metadata>
Oct 30 09:13:02 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:13:02 user nova-compute[75017]:     <system>
Oct 30 09:13:02 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:13:02 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:13:02 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:13:02 user nova-compute[75017]:       <entry name="serial">32e25927-79c3-490f-b53a-03d4a6299e42</entry>
Oct 30 09:13:02 user nova-compute[75017]:       <entry name="uuid">32e25927-79c3-490f-b53a-03d4a6299e42</entry>
Oct 30 09:13:02 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:13:02 user nova-compute[75017]:     </system>
Oct 30 09:13:02 user nova-compute[75017]:   </sysinfo>
Oct 30 09:13:02 user nova-compute[75017]:   <os>
Oct 30 09:13:02 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:13:02 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:13:02 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:13:02 user nova-compute[75017]:   </os>
Oct 30 09:13:02 user nova-compute[75017]:   <features>
Oct 30 09:13:02 user nova-compute[75017]:     <acpi/>
Oct 30 09:13:02 user nova-compute[75017]:     <apic/>
Oct 30 09:13:02 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:13:02 user nova-compute[75017]:   </features>
Oct 30 09:13:02 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:13:02 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:13:02 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:13:02 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:13:02 user nova-compute[75017]:   </clock>
Oct 30 09:13:02 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:13:02 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:13:02 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:13:02 user nova-compute[75017]:   </cpu>
Oct 30 09:13:02 user nova-compute[75017]:   <devices>
Oct 30 09:13:02 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:13:02 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:13:02 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk"/>
Oct 30 09:13:02 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:13:02 user nova-compute[75017]:     </disk>
Oct 30 09:13:02 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:13:02 user nova-compute[75017]:       <mac address="fa:16:3e:82:b1:c5"/>
Oct 30 09:13:02 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:13:02 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:13:02 user nova-compute[75017]:       <target dev="tap206f4965-cf"/>
Oct 30 09:13:02 user nova-compute[75017]:     </interface>
Oct 30 09:13:02 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:13:02 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/console.log" append="off"/>
Oct 30 09:13:02 user nova-compute[75017]:     </serial>
Oct 30 09:13:02 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:13:02 user nova-compute[75017]:     <video>
Oct 30 09:13:02 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:13:02 user nova-compute[75017]:     </video>
Oct 30 09:13:02 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:13:02 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:13:02 user nova-compute[75017]:     </rng>
Oct 30 09:13:02 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:13:02 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:13:02 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:13:02 user nova-compute[75017]:     </memballoon>
Oct 30 09:13:02 user nova-compute[75017]:   </devices>
Oct 30 09:13:02 user nova-compute[75017]: </domain>
Oct 30 09:13:02 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-980255719',display_name='tempest-VolumesAssistedSnapshotsTest-server-980255719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-980255719',id=8,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiniJ6k7LE2AC+XrNeRBK1F5zsv44UUAxUVO4FOXGxcJjFnrLdNzviWVrW1CbwY8iMnqocbYt3O+pAx47+KUnU0u4aQQnMsdOQ9WBbmwx0iLvrFTeZOfcktyEXH+QiYmg==',key_name='tempest-keypair-625456945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0293b9d9e7684474808321a8327d8338',ramdisk_id='',reservation_id='r-0xm1wm8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-221021361',owner_user_name='tempest-VolumesAssistedSnapshotsTest-221021361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23cd27d764e549da8d31f2061e0be75d',uuid=32e25927-79c3-490f-b53a-03d4a6299e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Converting VIF {"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=206f4965-cf18-4bb3-a500-f5190b3ef833,network=Network(340760f9-8f2b-4382-a61d-882225c35454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206f4965-cf') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG os_vif [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=206f4965-cf18-4bb3-a500-f5190b3ef833,network=Network(340760f9-8f2b-4382-a61d-882225c35454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206f4965-cf') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f25c9bf-aaaa-5e1e-b147-96265a25b239', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap206f4965-cf, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap206f4965-cf, col_values=(('qos', UUID('141b940d-25ae-4ea5-b92a-e6838840cafb')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap206f4965-cf, col_values=(('external_ids', {'iface-id': '206f4965-cf18-4bb3-a500-f5190b3ef833', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:b1:c5', 'vm-uuid': '32e25927-79c3-490f-b53a-03d4a6299e42'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:02 user nova-compute[75017]: INFO os_vif [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=206f4965-cf18-4bb3-a500-f5190b3ef833,network=Network(340760f9-8f2b-4382-a61d-882225c35454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206f4965-cf')
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] No VIF found with MAC fa:16:3e:82:b1:c5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.network.neutron [req-d8b4a240-f4bc-4b4f-ae3b-04aafb55acfc req-b35fc153-35ff-4f64-ac2e-d6a7772afa7c service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Updated VIF entry in instance network info cache for port 206f4965-cf18-4bb3-a500-f5190b3ef833. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG nova.network.neutron [req-d8b4a240-f4bc-4b4f-ae3b-04aafb55acfc req-b35fc153-35ff-4f64-ac2e-d6a7772afa7c service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Updating instance_info_cache with network_info: [{"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:13:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d8b4a240-f4bc-4b4f-ae3b-04aafb55acfc req-b35fc153-35ff-4f64-ac2e-d6a7772afa7c service nova] Releasing lock "refresh_cache-32e25927-79c3-490f-b53a-03d4a6299e42" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-8c27d71a-9747-458f-a7b7-86eba7512e23 req-46df44ad-7a3a-437e-ba8b-ec122a1c94bc service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received event network-vif-plugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8c27d71a-9747-458f-a7b7-86eba7512e23 req-46df44ad-7a3a-437e-ba8b-ec122a1c94bc service nova] Acquiring lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8c27d71a-9747-458f-a7b7-86eba7512e23 req-46df44ad-7a3a-437e-ba8b-ec122a1c94bc service nova] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8c27d71a-9747-458f-a7b7-86eba7512e23 req-46df44ad-7a3a-437e-ba8b-ec122a1c94bc service nova] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-8c27d71a-9747-458f-a7b7-86eba7512e23 req-46df44ad-7a3a-437e-ba8b-ec122a1c94bc service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] No waiting events found dispatching network-vif-plugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:03 user nova-compute[75017]: WARNING nova.compute.manager [req-8c27d71a-9747-458f-a7b7-86eba7512e23 req-46df44ad-7a3a-437e-ba8b-ec122a1c94bc service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received unexpected event network-vif-plugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f for instance with vm_state active and task_state None.
Oct 30 09:13:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:13:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Instance spawned successfully.
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:13:06 user nova-compute[75017]: INFO nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Took 6.77 seconds to spawn the instance on the hypervisor.
Oct 30 09:13:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:13:06 user nova-compute[75017]: INFO nova.compute.manager [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Took 8.11 seconds to build instance.
Oct 30 09:13:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7b0f018c-15e1-4074-a1fb-ec3c0973423b tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.299s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:11 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:13:11 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7848MB free_disk=25.621028900146484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 85ebda2b-e8bb-4931-9355-4e411d1aece9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d46e94f6-465d-4112-868e-acf8cea4f402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 963c57ec-14d7-43c1-a8dc-7a062446a559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance df215875-673c-4446-afa1-3446ff63edbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 17969235-fc8b-4b25-995b-fdce8b496974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 32e25927-79c3-490f-b53a-03d4a6299e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:13:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-fdeb9d6d-fcd2-4551-b009-22e1703279be req-2995ada2-5773-41d2-94b9-b3d3cf6ca0e8 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received event network-vif-plugged-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fdeb9d6d-fcd2-4551-b009-22e1703279be req-2995ada2-5773-41d2-94b9-b3d3cf6ca0e8 service nova] Acquiring lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fdeb9d6d-fcd2-4551-b009-22e1703279be req-2995ada2-5773-41d2-94b9-b3d3cf6ca0e8 service nova] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fdeb9d6d-fcd2-4551-b009-22e1703279be req-2995ada2-5773-41d2-94b9-b3d3cf6ca0e8 service nova] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-fdeb9d6d-fcd2-4551-b009-22e1703279be req-2995ada2-5773-41d2-94b9-b3d3cf6ca0e8 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] No waiting events found dispatching network-vif-plugged-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:12 user nova-compute[75017]: WARNING nova.compute.manager [req-fdeb9d6d-fcd2-4551-b009-22e1703279be req-2995ada2-5773-41d2-94b9-b3d3cf6ca0e8 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received unexpected event network-vif-plugged-06e70bc3-b779-49b1-be07-0e5247690823 for instance with vm_state active and task_state None.
Oct 30 09:13:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-85ebda2b-e8bb-4931-9355-4e411d1aece9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-85ebda2b-e8bb-4931-9355-4e411d1aece9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid 85ebda2b-e8bb-4931-9355-4e411d1aece9 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Updating instance_info_cache with network_info: [{"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-85ebda2b-e8bb-4931-9355-4e411d1aece9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:13:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:13:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-1e1dd03a-dd56-4e7c-9ee2-c3bf829f125c req-c984bcfe-0b4a-40ff-b5cb-cdda6b035626 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received event network-vif-plugged-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1e1dd03a-dd56-4e7c-9ee2-c3bf829f125c req-c984bcfe-0b4a-40ff-b5cb-cdda6b035626 service nova] Acquiring lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1e1dd03a-dd56-4e7c-9ee2-c3bf829f125c req-c984bcfe-0b4a-40ff-b5cb-cdda6b035626 service nova] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1e1dd03a-dd56-4e7c-9ee2-c3bf829f125c req-c984bcfe-0b4a-40ff-b5cb-cdda6b035626 service nova] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-1e1dd03a-dd56-4e7c-9ee2-c3bf829f125c req-c984bcfe-0b4a-40ff-b5cb-cdda6b035626 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] No waiting events found dispatching network-vif-plugged-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:14 user nova-compute[75017]: WARNING nova.compute.manager [req-1e1dd03a-dd56-4e7c-9ee2-c3bf829f125c req-c984bcfe-0b4a-40ff-b5cb-cdda6b035626 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received unexpected event network-vif-plugged-06e70bc3-b779-49b1-be07-0e5247690823 for instance with vm_state active and task_state None.
Oct 30 09:13:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-7fc472ad-0b51-495c-8734-1c95db283775 req-a35f65d6-e19e-4156-8e76-7d104f82bb20 service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Received event network-vif-plugged-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7fc472ad-0b51-495c-8734-1c95db283775 req-a35f65d6-e19e-4156-8e76-7d104f82bb20 service nova] Acquiring lock "963c57ec-14d7-43c1-a8dc-7a062446a559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7fc472ad-0b51-495c-8734-1c95db283775 req-a35f65d6-e19e-4156-8e76-7d104f82bb20 service nova] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7fc472ad-0b51-495c-8734-1c95db283775 req-a35f65d6-e19e-4156-8e76-7d104f82bb20 service nova] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-7fc472ad-0b51-495c-8734-1c95db283775 req-a35f65d6-e19e-4156-8e76-7d104f82bb20 service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] No waiting events found dispatching network-vif-plugged-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:19 user nova-compute[75017]: WARNING nova.compute.manager [req-7fc472ad-0b51-495c-8734-1c95db283775 req-a35f65d6-e19e-4156-8e76-7d104f82bb20 service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Received unexpected event network-vif-plugged-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a for instance with vm_state active and task_state None.
Oct 30 09:13:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Received event network-vif-plugged-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] Acquiring lock "963c57ec-14d7-43c1-a8dc-7a062446a559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] No waiting events found dispatching network-vif-plugged-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:21 user nova-compute[75017]: WARNING nova.compute.manager [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Received unexpected event network-vif-plugged-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a for instance with vm_state active and task_state None.
Oct 30 09:13:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received event network-vif-plugged-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] No waiting events found dispatching network-vif-plugged-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:21 user nova-compute[75017]: WARNING nova.compute.manager [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received unexpected event network-vif-plugged-206f4965-cf18-4bb3-a500-f5190b3ef833 for instance with vm_state active and task_state None.
Oct 30 09:13:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received event network-vif-plugged-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] No waiting events found dispatching network-vif-plugged-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:13:21 user nova-compute[75017]: WARNING nova.compute.manager [req-7a12ce4f-d1a5-44b9-a983-243cf9d4fb72 req-493034fe-2231-45c2-8797-89a502aab7fb service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received unexpected event network-vif-plugged-206f4965-cf18-4bb3-a500-f5190b3ef833 for instance with vm_state active and task_state None.
Oct 30 09:13:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "5a294811-e03d-4034-871d-db6ba2ad721d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:13:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:13:34 user nova-compute[75017]: INFO nova.compute.claims [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Claim successful on node user
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.network.neutron [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:13:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:13:35 user nova-compute[75017]: DEBUG nova.policy [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f08150a4aa4eff90af699ccc61d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734c9139fffd4605a81e382a6b54a0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:13:35 user nova-compute[75017]: INFO nova.virt.block_device [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Booting with volume 3a9871b3-cec4-447d-89c0-aa4d20fa3244 at /dev/vda
Oct 30 09:13:35 user nova-compute[75017]: DEBUG os_brick.utils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:13:35 user nova-compute[75017]: INFO oslo.privsep.daemon [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp6vjtzqgv/privsep.sock']
Oct 30 09:13:35 user sudo[86010]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp6vjtzqgv/privsep.sock
Oct 30 09:13:35 user sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 30 09:13:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Successfully created port: 0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:13:37 user sudo[86010]: pam_unix(sudo:session): session closed for user root
Oct 30 09:13:37 user nova-compute[75017]: INFO oslo.privsep.daemon [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Spawned new privsep daemon via rootwrap
Oct 30 09:13:37 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 30 09:13:37 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 30 09:13:37 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 30 09:13:37 user nova-compute[75017]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86013
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aab456-da19-466c-94ce-3f9241063751]: (2,) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Successfully updated port: 0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "refresh_cache-5a294811-e03d-4034-871d-db6ba2ad721d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquired lock "refresh_cache-5a294811-e03d-4034-871d-db6ba2ad721d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-48842300-afb4-4e86-8a27-95089b88dd30 req-7ec5cc09-3cc8-4d00-af32-bfccf414628e service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-changed-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-48842300-afb4-4e86-8a27-95089b88dd30 req-7ec5cc09-3cc8-4d00-af32-bfccf414628e service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Refreshing instance network info cache due to event network-changed-0710ebd4-b142-4fec-b28f-338eced9e4c7. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-48842300-afb4-4e86-8a27-95089b88dd30 req-7ec5cc09-3cc8-4d00-af32-bfccf414628e service nova] Acquiring lock "refresh_cache-5a294811-e03d-4034-871d-db6ba2ad721d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc1d22d-c588-4f7d-ba9e-b96d168569fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:37 user nova-compute[75017]: WARNING os_brick.initiator.connectors.nvmeof [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd058e4-963d-4442-b334-de618615fe25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a474dcf-9b3b-4af6-b75c-e1439991f26a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b466438-7cf5-4ee4-b6a4-3dd78259da01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:13:37 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1f72d0-018d-4913-adfa-69c97661a23d]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG os_brick.utils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] <== get_connector_properties: return (1817ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Updating existing volume attachment record: ee6a985a-dae0-43d9-b265-191c47ea83a5 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Updating instance_info_cache with network_info: [{"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Releasing lock "refresh_cache-5a294811-e03d-4034-871d-db6ba2ad721d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance network_info: |[{"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-48842300-afb4-4e86-8a27-95089b88dd30 req-7ec5cc09-3cc8-4d00-af32-bfccf414628e service nova] Acquired lock "refresh_cache-5a294811-e03d-4034-871d-db6ba2ad721d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:13:37 user nova-compute[75017]: DEBUG nova.network.neutron [req-48842300-afb4-4e86-8a27-95089b88dd30 req-7ec5cc09-3cc8-4d00-af32-bfccf414628e service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Refreshing network info cache for port 0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:13:38 user nova-compute[75017]: DEBUG nova.network.neutron [req-48842300-afb4-4e86-8a27-95089b88dd30 req-7ec5cc09-3cc8-4d00-af32-bfccf414628e service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Updated VIF entry in instance network info cache for port 0710ebd4-b142-4fec-b28f-338eced9e4c7. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:13:38 user nova-compute[75017]: DEBUG nova.network.neutron [req-48842300-afb4-4e86-8a27-95089b88dd30 req-7ec5cc09-3cc8-4d00-af32-bfccf414628e service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Updating instance_info_cache with network_info: [{"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:13:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-48842300-afb4-4e86-8a27-95089b88dd30 req-7ec5cc09-3cc8-4d00-af32-bfccf414628e service nova] Releasing lock "refresh_cache-5a294811-e03d-4034-871d-db6ba2ad721d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:13:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:13:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:13:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:13:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:13:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:13:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:13:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:13:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:13:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:13:57 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Creating image(s)
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Ensure instance console log exists: /opt/stack/data/nova/instances/5a294811-e03d-4034-871d-db6ba2ad721d/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Start _get_guest_xml network_info=[{"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoyQnSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a294811-e03d-4034-871d-db6ba2ad721d', 'attached_at': '', 'detached_at': '', 'volume_id': '3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'serial': '3a9871b3-cec4-447d-89c0-aa4d20fa3244'}, 'disk_bus': 'virtio', 'attachment_id': 'ee6a985a-dae0-43d9-b265-191c47ea83a5', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:13:57 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:13:57 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connector [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Factory for ISCSI on None {{(pid=75017) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoyQnSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:13:57 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:13:57 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:13:57 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8288b4e6-b1c3-4697-a350-fe4428d2e10f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:13:57 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f66a6-8c02-4e26-b537-acad9ded22de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244] added
Oct 30 09:13:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c36dc3-a4e7-4302-bd43-8a522f8f67c1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7a708a-0850-4e33-a356-0a9fe9fac1bc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAoyQnSZ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAoyQnSZ" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f62f1b-ba12-4a27-ad6b-a42d1eba584f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FAoyQnSZ'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7ebc11-14c2-4920-9905-606850f6d44e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a83cef-cb70-47e3-88e3-5ede59727114]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 09:13:57 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 09:13:57 user nova-compute[75017]:  {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:13:57 user nova-compute[75017]: WARNING os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 09:13:57 user nova-compute[75017]: 
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a9c20f-9f3a-4057-bd95-e926bb6d2741]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260]
Oct 30 09:13:57 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260] successful.
Oct 30 09:13:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a031837d-7095-4981-8a0d-04afc75486e0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22ff853-d477-451d-b6d7-402fc87008f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:13:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:13:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:13:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:13:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:13:58 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[46df3332-4607-4db0-899d-9b6e5169da61]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:13:58 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:13:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoyQnSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26333346235353632', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333346235353632', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-336386316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336386316',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK41I5D09IEItrwBGv57T/9QpZ4xvfrikmugxYqYCeOgq36dju7nfyqi8IgYaIAFEzcXXx+7C1Q8g3cHSKYsfkHntXkvMk131KHuB14YNxNDJqfZXdzIIjjyJdTTefyNRA==',key_name='tempest-keypair-1967695828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='734c9139fffd4605a81e382a6b54a0e6',ramdisk_id='',reservation_id='r-takylgq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1641318212',owner_user_name='tempest-ServerActionsV293TestJSON-1641318212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:13:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f08150a4aa4eff90af699ccc61d4e5',uuid=5a294811-e03d-4034-871d-db6ba2ad721d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converting VIF {"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.objects.instance [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a294811-e03d-4034-871d-db6ba2ad721d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:13:59 user nova-compute[75017]:   <uuid>5a294811-e03d-4034-871d-db6ba2ad721d</uuid>
Oct 30 09:13:59 user nova-compute[75017]:   <name>instance-00000009</name>
Oct 30 09:13:59 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:13:59 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:13:59 user nova-compute[75017]:   <metadata>
Oct 30 09:13:59 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:13:59 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:13:59 user nova-compute[75017]:       <nova:name>tempest-ServerActionsV293TestJSON-server-336386316</nova:name>
Oct 30 09:13:59 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:13:57</nova:creationTime>
Oct 30 09:13:59 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:13:59 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:13:59 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:13:59 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:13:59 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:13:59 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:13:59 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:13:59 user nova-compute[75017]:       <nova:owner>
Oct 30 09:13:59 user nova-compute[75017]:         <nova:user uuid="85f08150a4aa4eff90af699ccc61d4e5">tempest-ServerActionsV293TestJSON-1641318212-project-member</nova:user>
Oct 30 09:13:59 user nova-compute[75017]:         <nova:project uuid="734c9139fffd4605a81e382a6b54a0e6">tempest-ServerActionsV293TestJSON-1641318212</nova:project>
Oct 30 09:13:59 user nova-compute[75017]:       </nova:owner>
Oct 30 09:13:59 user nova-compute[75017]:       <nova:ports>
Oct 30 09:13:59 user nova-compute[75017]:         <nova:port uuid="0710ebd4-b142-4fec-b28f-338eced9e4c7">
Oct 30 09:13:59 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:13:59 user nova-compute[75017]:         </nova:port>
Oct 30 09:13:59 user nova-compute[75017]:       </nova:ports>
Oct 30 09:13:59 user nova-compute[75017]:     </nova:instance>
Oct 30 09:13:59 user nova-compute[75017]:   </metadata>
Oct 30 09:13:59 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:13:59 user nova-compute[75017]:     <system>
Oct 30 09:13:59 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:13:59 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:13:59 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:13:59 user nova-compute[75017]:       <entry name="serial">5a294811-e03d-4034-871d-db6ba2ad721d</entry>
Oct 30 09:13:59 user nova-compute[75017]:       <entry name="uuid">5a294811-e03d-4034-871d-db6ba2ad721d</entry>
Oct 30 09:13:59 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:13:59 user nova-compute[75017]:     </system>
Oct 30 09:13:59 user nova-compute[75017]:   </sysinfo>
Oct 30 09:13:59 user nova-compute[75017]:   <os>
Oct 30 09:13:59 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:13:59 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:13:59 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:13:59 user nova-compute[75017]:   </os>
Oct 30 09:13:59 user nova-compute[75017]:   <features>
Oct 30 09:13:59 user nova-compute[75017]:     <acpi/>
Oct 30 09:13:59 user nova-compute[75017]:     <apic/>
Oct 30 09:13:59 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:13:59 user nova-compute[75017]:   </features>
Oct 30 09:13:59 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:13:59 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:13:59 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:13:59 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:13:59 user nova-compute[75017]:   </clock>
Oct 30 09:13:59 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:13:59 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:13:59 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:13:59 user nova-compute[75017]:   </cpu>
Oct 30 09:13:59 user nova-compute[75017]:   <devices>
Oct 30 09:13:59 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:13:59 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:13:59 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:13:59 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:13:59 user nova-compute[75017]:       <serial>3a9871b3-cec4-447d-89c0-aa4d20fa3244</serial>
Oct 30 09:13:59 user nova-compute[75017]:     </disk>
Oct 30 09:13:59 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:13:59 user nova-compute[75017]:       <mac address="fa:16:3e:be:0d:f7"/>
Oct 30 09:13:59 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:13:59 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:13:59 user nova-compute[75017]:       <target dev="tap0710ebd4-b1"/>
Oct 30 09:13:59 user nova-compute[75017]:     </interface>
Oct 30 09:13:59 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:13:59 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/5a294811-e03d-4034-871d-db6ba2ad721d/console.log" append="off"/>
Oct 30 09:13:59 user nova-compute[75017]:     </serial>
Oct 30 09:13:59 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:13:59 user nova-compute[75017]:     <video>
Oct 30 09:13:59 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:13:59 user nova-compute[75017]:     </video>
Oct 30 09:13:59 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:13:59 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:13:59 user nova-compute[75017]:     </rng>
Oct 30 09:13:59 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:13:59 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:13:59 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:13:59 user nova-compute[75017]:     </memballoon>
Oct 30 09:13:59 user nova-compute[75017]:   </devices>
Oct 30 09:13:59 user nova-compute[75017]: </domain>
Oct 30 09:13:59 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-336386316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336386316',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK41I5D09IEItrwBGv57T/9QpZ4xvfrikmugxYqYCeOgq36dju7nfyqi8IgYaIAFEzcXXx+7C1Q8g3cHSKYsfkHntXkvMk131KHuB14YNxNDJqfZXdzIIjjyJdTTefyNRA==',key_name='tempest-keypair-1967695828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='734c9139fffd4605a81e382a6b54a0e6',ramdisk_id='',reservation_id='r-takylgq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1641318212',owner_user_name='tempest-ServerActionsV293TestJSON-1641318212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:13:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f08150a4aa4eff90af699ccc61d4e5',uuid=5a294811-e03d-4034-871d-db6ba2ad721d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converting VIF {"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG os_vif [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82d0878e-ea0d-5e93-8a2b-fbe762d354e0', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0710ebd4-b1, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0710ebd4-b1, col_values=(('qos', UUID('97d0ac93-73cc-49fa-96a4-e43544596c3e')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0710ebd4-b1, col_values=(('external_ids', {'iface-id': '0710ebd4-b142-4fec-b28f-338eced9e4c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:0d:f7', 'vm-uuid': '5a294811-e03d-4034-871d-db6ba2ad721d'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:13:59 user nova-compute[75017]: INFO os_vif [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1')
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:13:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] No VIF found with MAC fa:16:3e:be:0d:f7, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:14:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-c1baa860-fdd5-4a17-bbc9-a0c98678cea0 req-e2d5911e-ad99-4f1e-9bcb-5b6d63f49d4b service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c1baa860-fdd5-4a17-bbc9-a0c98678cea0 req-e2d5911e-ad99-4f1e-9bcb-5b6d63f49d4b service nova] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c1baa860-fdd5-4a17-bbc9-a0c98678cea0 req-e2d5911e-ad99-4f1e-9bcb-5b6d63f49d4b service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c1baa860-fdd5-4a17-bbc9-a0c98678cea0 req-e2d5911e-ad99-4f1e-9bcb-5b6d63f49d4b service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-c1baa860-fdd5-4a17-bbc9-a0c98678cea0 req-e2d5911e-ad99-4f1e-9bcb-5b6d63f49d4b service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] No waiting events found dispatching network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:14:00 user nova-compute[75017]: WARNING nova.compute.manager [req-c1baa860-fdd5-4a17-bbc9-a0c98678cea0 req-e2d5911e-ad99-4f1e-9bcb-5b6d63f49d4b service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received unexpected event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 for instance with vm_state building and task_state spawning.
Oct 30 09:14:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:14:02 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance spawned successfully.
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:14:02 user nova-compute[75017]: INFO nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Took 5.06 seconds to spawn the instance on the hypervisor.
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:14:02 user nova-compute[75017]: INFO nova.compute.manager [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Took 28.07 seconds to build instance.
Oct 30 09:14:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-be30da05-20da-4abf-a3b3-08638ba2bfbb tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "5a294811-e03d-4034-871d-db6ba2ad721d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.226s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-17485469-1e91-4156-bd67-fa83f6d28a43 req-6e99d865-ce66-4adb-b721-203becaa8118 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-17485469-1e91-4156-bd67-fa83f6d28a43 req-6e99d865-ce66-4adb-b721-203becaa8118 service nova] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-17485469-1e91-4156-bd67-fa83f6d28a43 req-6e99d865-ce66-4adb-b721-203becaa8118 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-17485469-1e91-4156-bd67-fa83f6d28a43 req-6e99d865-ce66-4adb-b721-203becaa8118 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-17485469-1e91-4156-bd67-fa83f6d28a43 req-6e99d865-ce66-4adb-b721-203becaa8118 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] No waiting events found dispatching network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:14:02 user nova-compute[75017]: WARNING nova.compute.manager [req-17485469-1e91-4156-bd67-fa83f6d28a43 req-6e99d865-ce66-4adb-b721-203becaa8118 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received unexpected event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 for instance with vm_state active and task_state None.
Oct 30 09:14:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:06 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:06 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:06 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:14:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:14:09 user nova-compute[75017]: INFO nova.compute.claims [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Claim successful on node user
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:14:10 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.policy [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4b6d1aed2074fa7a74256a8764b44bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4965ad5176314c298c0e1ce3cf0995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:14:10 user nova-compute[75017]: INFO nova.virt.block_device [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Booting with volume 90ad41d5-afce-494c-b728-29ade5213a78 at /dev/vda
Oct 30 09:14:10 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:14:10 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7392MB free_disk=25.497222900390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG os_brick.utils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d91be1d-af18-418d-85bf-1f69718d691d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lazy-loading 'flavor' on Instance uuid 85ebda2b-e8bb-4931-9355-4e411d1aece9 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdfbc5e-377a-4c50-b0ca-6ee0ba9313f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca89e6f-9c2f-49eb-a43c-c8a0a0871f69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb5cfee-1cf9-4218-b4b0-b14f7e8d29f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 85ebda2b-e8bb-4931-9355-4e411d1aece9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d46e94f6-465d-4112-868e-acf8cea4f402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 963c57ec-14d7-43c1-a8dc-7a062446a559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance df215875-673c-4446-afa1-3446ff63edbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 17969235-fc8b-4b25-995b-fdce8b496974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 32e25927-79c3-490f-b53a-03d4a6299e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5a294811-e03d-4034-871d-db6ba2ad721d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:14:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:11 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c9fe2c-c5bc-4cad-b419-b38620055c8b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.utils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating existing volume attachment record: 0af2db08-904e-42e6-a5ca-c687f706867a {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.143s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:11 user nova-compute[75017]: INFO nova.compute.manager [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Attaching volume 94174d8c-8178-4c6b-a830-7e9f6f76d5ae to /dev/vdb
Oct 30 09:14:11 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.utils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[81de890f-6c4b-4c70-8cbf-4ff1d4d410a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[63143925-662b-462f-93f7-20ab89740308]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f8dfdf-1324-4655-ba30-e6db94066960]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e755f2-9428-4f5c-b4eb-b0b34d3adb2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:11 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:14:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e375c23-8db7-4328-a6d2-98649be3aaef]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG os_brick.utils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Updating existing volume attachment record: ae3cab8a-8e15-4c48-8b1f-72f6aabed786 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:14:11 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully created port: c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:14:12 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:12 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:12 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:12 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:14:12 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully created port: 49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:14:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:12 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:14:13 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully created port: e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:14:13 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Updating instance_info_cache with network_info: [{"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:14:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:14:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:14:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:14:14 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully created port: 6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:14:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-216bc124-1ef8-4bb0-8f32-462c6b43a521 req-3d651752-8a59-4c00-8ef4-af37f0178447 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received event network-changed-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-216bc124-1ef8-4bb0-8f32-462c6b43a521 req-3d651752-8a59-4c00-8ef4-af37f0178447 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Refreshing instance network info cache due to event network-changed-06e70bc3-b779-49b1-be07-0e5247690823. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-216bc124-1ef8-4bb0-8f32-462c6b43a521 req-3d651752-8a59-4c00-8ef4-af37f0178447 service nova] Acquiring lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-216bc124-1ef8-4bb0-8f32-462c6b43a521 req-3d651752-8a59-4c00-8ef4-af37f0178447 service nova] Acquired lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:14 user nova-compute[75017]: DEBUG nova.network.neutron [req-216bc124-1ef8-4bb0-8f32-462c6b43a521 req-3d651752-8a59-4c00-8ef4-af37f0178447 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Refreshing network info cache for port 06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:14 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully created port: e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:14:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-216bc124-1ef8-4bb0-8f32-462c6b43a521 req-3d651752-8a59-4c00-8ef4-af37f0178447 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updated VIF entry in instance network info cache for port 06e70bc3-b779-49b1-be07-0e5247690823. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-216bc124-1ef8-4bb0-8f32-462c6b43a521 req-3d651752-8a59-4c00-8ef4-af37f0178447 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updating instance_info_cache with network_info: [{"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-216bc124-1ef8-4bb0-8f32-462c6b43a521 req-3d651752-8a59-4c00-8ef4-af37f0178447 service nova] Releasing lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully updated port: c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-cff26654-7f1f-4948-a21d-7d49e9cd080e req-335b5e50-6ad8-4336-810b-d7c7ced07e05 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-changed-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-cff26654-7f1f-4948-a21d-7d49e9cd080e req-335b5e50-6ad8-4336-810b-d7c7ced07e05 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing instance network info cache due to event network-changed-c75be99b-5a95-4330-acbb-12f982a1c492. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cff26654-7f1f-4948-a21d-7d49e9cd080e req-335b5e50-6ad8-4336-810b-d7c7ced07e05 service nova] Acquiring lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cff26654-7f1f-4948-a21d-7d49e9cd080e req-335b5e50-6ad8-4336-810b-d7c7ced07e05 service nova] Acquired lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-cff26654-7f1f-4948-a21d-7d49e9cd080e req-335b5e50-6ad8-4336-810b-d7c7ced07e05 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing network info cache for port c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-cff26654-7f1f-4948-a21d-7d49e9cd080e req-335b5e50-6ad8-4336-810b-d7c7ced07e05 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:14:16 user nova-compute[75017]: DEBUG nova.network.neutron [req-cff26654-7f1f-4948-a21d-7d49e9cd080e req-335b5e50-6ad8-4336-810b-d7c7ced07e05 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cff26654-7f1f-4948-a21d-7d49e9cd080e req-335b5e50-6ad8-4336-810b-d7c7ced07e05 service nova] Releasing lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully updated port: 8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:14:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-373cdd47-60d4-4c5f-89a6-a22f20bf83c1 req-8c4b27e2-416c-40fd-bc0e-c0e939dff68b service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received event network-changed-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-373cdd47-60d4-4c5f-89a6-a22f20bf83c1 req-8c4b27e2-416c-40fd-bc0e-c0e939dff68b service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Refreshing instance network info cache due to event network-changed-834b1d2f-e0bb-4ba4-a21d-126b54f6f432. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-373cdd47-60d4-4c5f-89a6-a22f20bf83c1 req-8c4b27e2-416c-40fd-bc0e-c0e939dff68b service nova] Acquiring lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-373cdd47-60d4-4c5f-89a6-a22f20bf83c1 req-8c4b27e2-416c-40fd-bc0e-c0e939dff68b service nova] Acquired lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:16 user nova-compute[75017]: DEBUG nova.network.neutron [req-373cdd47-60d4-4c5f-89a6-a22f20bf83c1 req-8c4b27e2-416c-40fd-bc0e-c0e939dff68b service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Refreshing network info cache for port 834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-373cdd47-60d4-4c5f-89a6-a22f20bf83c1 req-8c4b27e2-416c-40fd-bc0e-c0e939dff68b service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Updated VIF entry in instance network info cache for port 834b1d2f-e0bb-4ba4-a21d-126b54f6f432. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-373cdd47-60d4-4c5f-89a6-a22f20bf83c1 req-8c4b27e2-416c-40fd-bc0e-c0e939dff68b service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Updating instance_info_cache with network_info: [{"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-373cdd47-60d4-4c5f-89a6-a22f20bf83c1 req-8c4b27e2-416c-40fd-bc0e-c0e939dff68b service nova] Releasing lock "refresh_cache-d46e94f6-465d-4112-868e-acf8cea4f402" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully updated port: 288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-changed-8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing instance network info cache due to event network-changed-8bf40fff-eeab-4a60-ae57-e3229ebac120. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] Acquiring lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] Acquired lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing network info cache for port 8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG nova.network.neutron [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] Releasing lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-changed-288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing instance network info cache due to event network-changed-288a1cda-73d5-4222-a7a9-5657efaa45da. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] Acquiring lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] Acquired lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG nova.network.neutron [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing network info cache for port 288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully updated port: 49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG nova.network.neutron [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG nova.network.neutron [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9bb80fcd-844c-4269-ad99-fc5aeecf1aa1 req-89fee4fa-14c8-4061-a269-e8029f95584a service nova] Releasing lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:18 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully updated port: e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:14:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:19 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully updated port: 6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:14:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-changed-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing instance network info cache due to event network-changed-49e4404a-1322-473f-bb99-9ba80c17d01f. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] Acquiring lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] Acquired lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing network info cache for port 49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Successfully updated port: e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] Releasing lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-changed-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing instance network info cache due to event network-changed-e924d1fa-1e09-4b03-a940-0408f564be1e. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] Acquiring lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] Acquired lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing network info cache for port e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] Releasing lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-changed-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing instance network info cache due to event network-changed-6009b5bc-376f-4b61-8e1c-b0bb4864c686. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] Acquiring lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] Acquired lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing network info cache for port 6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.objects.instance [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'flavor' on Instance uuid d46e94f6-465d-4112-868e-acf8cea4f402 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2607944-d133-49f8-b29b-73f3b62427ca req-8781ebcf-80a0-48af-9420-591d05ee2a57 service nova] Releasing lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquired lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:20 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:21 user nova-compute[75017]: INFO nova.compute.manager [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Attaching volume 5cdb7bf0-270f-433e-b323-88c35d27d339 to /dev/vdb
Oct 30 09:14:21 user nova-compute[75017]: DEBUG os_brick.utils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e5d5e3-64c9-4ee9-a133-26d4a2088b8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb1c5c2-3b57-4c03-b191-dfb488de3677]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3bf1c3-6d91-44b3-b752-8228e7c6ecb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2b3e6b-ea8f-42cc-9f4a-f07b9b57851e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:21 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:14:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[74915ab2-c659-434d-9f06-cfec5900c86a]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG os_brick.utils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:14:21 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Updating existing volume attachment record: 9d35d6d1-28de-4eea-a997-a1fc5a290231 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:14:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-6ffc33a3-bcfc-476f-8c35-4304c54441e5 req-25c80fbc-79d6-4c9b-a40f-5664adbc48f4 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-changed-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-6ffc33a3-bcfc-476f-8c35-4304c54441e5 req-25c80fbc-79d6-4c9b-a40f-5664adbc48f4 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing instance network info cache due to event network-changed-e0f83c4e-90a4-46d9-852a-91a732e2fdde. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6ffc33a3-bcfc-476f-8c35-4304c54441e5 req-25c80fbc-79d6-4c9b-a40f-5664adbc48f4 service nova] Acquiring lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [{"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Releasing lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance network_info: |[{"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:14:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6ffc33a3-bcfc-476f-8c35-4304c54441e5 req-25c80fbc-79d6-4c9b-a40f-5664adbc48f4 service nova] Acquired lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:22 user nova-compute[75017]: DEBUG nova.network.neutron [req-6ffc33a3-bcfc-476f-8c35-4304c54441e5 req-25c80fbc-79d6-4c9b-a40f-5664adbc48f4 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing network info cache for port e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-6ffc33a3-bcfc-476f-8c35-4304c54441e5 req-25c80fbc-79d6-4c9b-a40f-5664adbc48f4 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updated VIF entry in instance network info cache for port e0f83c4e-90a4-46d9-852a-91a732e2fdde. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:14:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-6ffc33a3-bcfc-476f-8c35-4304c54441e5 req-25c80fbc-79d6-4c9b-a40f-5664adbc48f4 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [{"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6ffc33a3-bcfc-476f-8c35-4304c54441e5 req-25c80fbc-79d6-4c9b-a40f-5664adbc48f4 service nova] Releasing lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-def206c3-655d-4f79-8372-d41ef1c35569 req-39e45900-24a6-4442-a003-70ed2dfe9e3e service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Received event network-changed-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-def206c3-655d-4f79-8372-d41ef1c35569 req-39e45900-24a6-4442-a003-70ed2dfe9e3e service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Refreshing instance network info cache due to event network-changed-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-def206c3-655d-4f79-8372-d41ef1c35569 req-39e45900-24a6-4442-a003-70ed2dfe9e3e service nova] Acquiring lock "refresh_cache-963c57ec-14d7-43c1-a8dc-7a062446a559" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-def206c3-655d-4f79-8372-d41ef1c35569 req-39e45900-24a6-4442-a003-70ed2dfe9e3e service nova] Acquired lock "refresh_cache-963c57ec-14d7-43c1-a8dc-7a062446a559" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-def206c3-655d-4f79-8372-d41ef1c35569 req-39e45900-24a6-4442-a003-70ed2dfe9e3e service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Refreshing network info cache for port 5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-def206c3-655d-4f79-8372-d41ef1c35569 req-39e45900-24a6-4442-a003-70ed2dfe9e3e service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Updated VIF entry in instance network info cache for port 5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:14:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-def206c3-655d-4f79-8372-d41ef1c35569 req-39e45900-24a6-4442-a003-70ed2dfe9e3e service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Updating instance_info_cache with network_info: [{"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-def206c3-655d-4f79-8372-d41ef1c35569 req-39e45900-24a6-4442-a003-70ed2dfe9e3e service nova] Releasing lock "refresh_cache-963c57ec-14d7-43c1-a8dc-7a062446a559" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRAFbGOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:14:32 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:14:32 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:14:32 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e344065-e0e7-4eba-91db-536d50bd701a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:14:32 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe0c9c-cf51-47dc-8186-be062df9688a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae] added
Oct 30 09:14:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3e0eb5-5935-4894-9a86-e86807738ca1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32bf877-1490-49d7-a9b4-5ed403aa4cc4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRAFbGOK {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRAFbGOK" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[56999796-50bc-4a83-981d-67fe2c7b6a63]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRAFbGOK'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc68da93-4813-480c-9e3a-6b6eb3ee9f5b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f5b3e-0ca0-451f-b6b9-39253f4a2372]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[904e61ad-67f5-4496-8f62-62d2dae19f8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae, portal: 172.16.0.220,3260]
Oct 30 09:14:32 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae, portal: 172.16.0.220,3260] successful.
Oct 30 09:14:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a41c4a-142d-4476-a35b-cc7fab840314]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a8f5da-2161-4175-bfb6-38036025ea46]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:32 user nova-compute[75017]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae (non-flash)
Oct 30 09:14:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:32 user nova-compute[75017]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae (non-flash)
Oct 30 09:14:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-36ddbac6-a29e-4447-9a34-d0a342109aea req-9e040453-ac6e-4ca3-b75b-ea7f6ecc314f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received event network-changed-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-36ddbac6-a29e-4447-9a34-d0a342109aea req-9e040453-ac6e-4ca3-b75b-ea7f6ecc314f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Refreshing instance network info cache due to event network-changed-f159fe03-fe4c-4373-9e01-c65efbcf5c6b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36ddbac6-a29e-4447-9a34-d0a342109aea req-9e040453-ac6e-4ca3-b75b-ea7f6ecc314f service nova] Acquiring lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36ddbac6-a29e-4447-9a34-d0a342109aea req-9e040453-ac6e-4ca3-b75b-ea7f6ecc314f service nova] Acquired lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-36ddbac6-a29e-4447-9a34-d0a342109aea req-9e040453-ac6e-4ca3-b75b-ea7f6ecc314f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Refreshing network info cache for port f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[95917955-4ab6-4072-91c3-6519d9a141f3]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRAFbGOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-36ddbac6-a29e-4447-9a34-d0a342109aea req-9e040453-ac6e-4ca3-b75b-ea7f6ecc314f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updated VIF entry in instance network info cache for port f159fe03-fe4c-4373-9e01-c65efbcf5c6b. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-36ddbac6-a29e-4447-9a34-d0a342109aea req-9e040453-ac6e-4ca3-b75b-ea7f6ecc314f service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updating instance_info_cache with network_info: [{"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36ddbac6-a29e-4447-9a34-d0a342109aea req-9e040453-ac6e-4ca3-b75b-ea7f6ecc314f service nova] Releasing lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:14:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26265366565333235', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:14:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265366565333235', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:14:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lazy-loading 'flavor' on Instance uuid 85ebda2b-e8bb-4931-9355-4e411d1aece9 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:14:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:14:33 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:14:33 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:14:33 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:14:33 user nova-compute[75017]:   <serial>94174d8c-8178-4c6b-a830-7e9f6f76d5ae</serial>
Oct 30 09:14:33 user nova-compute[75017]: </disk>
Oct 30 09:14:33 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:14:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:14:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:14:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] No VIF found with MAC fa:16:3e:1a:1f:6e, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b770b24d-4e20-461c-ade3-66f10bc71d52 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.796s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:34 user nova-compute[75017]: INFO nova.compute.manager [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Terminating instance
Oct 30 09:14:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-c036d412-cada-4e62-a996-86d223ff2869 req-46f6f698-481e-4ee1-8e82-542bbd2c4b24 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received event network-vif-unplugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c036d412-cada-4e62-a996-86d223ff2869 req-46f6f698-481e-4ee1-8e82-542bbd2c4b24 service nova] Acquiring lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c036d412-cada-4e62-a996-86d223ff2869 req-46f6f698-481e-4ee1-8e82-542bbd2c4b24 service nova] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c036d412-cada-4e62-a996-86d223ff2869 req-46f6f698-481e-4ee1-8e82-542bbd2c4b24 service nova] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-c036d412-cada-4e62-a996-86d223ff2869 req-46f6f698-481e-4ee1-8e82-542bbd2c4b24 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] No waiting events found dispatching network-vif-unplugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-c036d412-cada-4e62-a996-86d223ff2869 req-46f6f698-481e-4ee1-8e82-542bbd2c4b24 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received event network-vif-unplugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Instance destroyed successfully.
Oct 30 09:14:35 user nova-compute[75017]: DEBUG nova.objects.instance [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lazy-loading 'resources' on Instance uuid 85ebda2b-e8bb-4931-9355-4e411d1aece9 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1477754800',display_name='tempest-DeleteServersTestJSON-server-1477754800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1477754800',id=1,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:12:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3839f70b8e941b886948ff6b370b43b',ramdisk_id='',reservation_id='r-6qbolaej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-891108301',owner_user_name='tempest-DeleteServersTestJSON-891108301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:12:29Z,user_data=None,user_id='ea5cdd1050e8480ebd5686030df32f65',uuid=85ebda2b-e8bb-4931-9355-4e411d1aece9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Converting VIF {"id": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "address": "fa:16:3e:1a:1f:6e", "network": {"id": "b94c5ac5-1216-481a-b351-1a8c52c417b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169248119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3839f70b8e941b886948ff6b370b43b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb03ff3cd-2f", "ovs_interfaceid": "b03ff3cd-2f01-42df-9c9e-124cbdea975f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:1f:6e,bridge_name='br-int',has_traffic_filtering=True,id=b03ff3cd-2f01-42df-9c9e-124cbdea975f,network=Network(b94c5ac5-1216-481a-b351-1a8c52c417b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb03ff3cd-2f') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_vif [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:1f:6e,bridge_name='br-int',has_traffic_filtering=True,id=b03ff3cd-2f01-42df-9c9e-124cbdea975f,network=Network(b94c5ac5-1216-481a-b351-1a8c52c417b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb03ff3cd-2f') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb03ff3cd-2f, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09c55fc3-a9c5-462a-8a70-a8907fb7fb7a) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:35 user nova-compute[75017]: INFO os_vif [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:1f:6e,bridge_name='br-int',has_traffic_filtering=True,id=b03ff3cd-2f01-42df-9c9e-124cbdea975f,network=Network(b94c5ac5-1216-481a-b351-1a8c52c417b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb03ff3cd-2f')
Oct 30 09:14:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRAFbGOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:14:35 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7879581b-9e91-4914-be30-d63d33ab7f96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:14:35 user nova-compute[75017]: No targets found.
Oct 30 09:14:35 user nova-compute[75017]: iSNS:
Oct 30 09:14:35 user nova-compute[75017]: No targets found.
Oct 30 09:14:35 user nova-compute[75017]: STATIC:
Oct 30 09:14:35 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae
Oct 30 09:14:35 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:14:35 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:14:35 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244
Oct 30 09:14:35 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:14:35 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:14:35 user nova-compute[75017]: FIRMWARE:
Oct 30 09:14:35 user nova-compute[75017]: No targets found.
Oct 30 09:14:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:14:35 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:14:35 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[645c1727-dc9c-4d5e-8a06-f936ef83288e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe3ec4f-393f-4431-b873-5e2ba03631ad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:35 user nova-compute[75017]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae (non-flash)
Oct 30 09:14:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:35 user nova-compute[75017]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae (non-flash)
Oct 30 09:14:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf03a2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab7e1e0-3552-4f45-bf62-a49e1396eb7f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8daf51-0ecc-48c6-8524-aad93b7b222a]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[562ea094-44aa-47d6-b086-187b27938f86]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34b4009-5d77-4019-b44e-20acef46a346]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b969aed7-5243-4e18-890f-96ada4ca7689]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f387f-f6c3-4d56-a464-1c22493ac2cd]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae, portal: 172.16.0.220,3260]
Oct 30 09:14:35 user nova-compute[75017]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae, portal: 172.16.0.220,3260] successful.
Oct 30 09:14:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94174d8c-8178-4c6b-a830-7e9f6f76d5ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aad17c-81f3-4561-8462-f59e7c4fb591]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] <== disconnect_volume: return (326ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:14:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:14:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Deleting instance files /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9_del
Oct 30 09:14:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Deletion of /opt/stack/data/nova/instances/85ebda2b-e8bb-4931-9355-4e411d1aece9_del complete
Oct 30 09:14:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75017) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 30 09:14:36 user nova-compute[75017]: INFO nova.virt.libvirt.host [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] UEFI support detected
Oct 30 09:14:36 user nova-compute[75017]: INFO nova.compute.manager [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 30 09:14:36 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:14:36 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:14:36 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:14:36 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:36 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Took 0.90 seconds to deallocate network for instance.
Oct 30 09:14:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-eb89dd77-66e9-47be-896c-bd58f52148c5 req-236aa66b-8384-45a9-83bd-9652d5d37b99 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received event network-vif-plugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eb89dd77-66e9-47be-896c-bd58f52148c5 req-236aa66b-8384-45a9-83bd-9652d5d37b99 service nova] Acquiring lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eb89dd77-66e9-47be-896c-bd58f52148c5 req-236aa66b-8384-45a9-83bd-9652d5d37b99 service nova] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eb89dd77-66e9-47be-896c-bd58f52148c5 req-236aa66b-8384-45a9-83bd-9652d5d37b99 service nova] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-eb89dd77-66e9-47be-896c-bd58f52148c5 req-236aa66b-8384-45a9-83bd-9652d5d37b99 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] No waiting events found dispatching network-vif-plugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:14:37 user nova-compute[75017]: WARNING nova.compute.manager [req-eb89dd77-66e9-47be-896c-bd58f52148c5 req-236aa66b-8384-45a9-83bd-9652d5d37b99 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received unexpected event network-vif-plugged-b03ff3cd-2f01-42df-9c9e-124cbdea975f for instance with vm_state active and task_state deleting.
Oct 30 09:14:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-eb89dd77-66e9-47be-896c-bd58f52148c5 req-236aa66b-8384-45a9-83bd-9652d5d37b99 service nova] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Received event network-vif-deleted-b03ff3cd-2f01-42df-9c9e-124cbdea975f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:37 user nova-compute[75017]: INFO nova.compute.manager [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] [instance: 85ebda2b-e8bb-4931-9355-4e411d1aece9] Took 1.06 seconds to detach 1 volumes for instance.
Oct 30 09:14:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "963c57ec-14d7-43c1-a8dc-7a062446a559" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG nova.objects.instance [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lazy-loading 'flavor' on Instance uuid 963c57ec-14d7-43c1-a8dc-7a062446a559 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lazy-loading 'flavor' on Instance uuid 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:38 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Deleted allocations for instance 85ebda2b-e8bb-4931-9355-4e411d1aece9
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:38 user nova-compute[75017]: INFO nova.compute.manager [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Attaching volume c3b080cd-4ffc-48c2-bd79-3dda74e60d4f to /dev/vdb
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-52b71f2f-eb86-4537-9737-1c9a19792dd8 tempest-DeleteServersTestJSON-891108301 tempest-DeleteServersTestJSON-891108301-project-member] Lock "85ebda2b-e8bb-4931-9355-4e411d1aece9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.960s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "963c57ec-14d7-43c1-a8dc-7a062446a559" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:38 user nova-compute[75017]: INFO nova.compute.manager [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Attaching volume 6baad9d2-42f6-46c9-a5f4-bc8bee3a882c to /dev/sdc
Oct 30 09:14:38 user nova-compute[75017]: DEBUG os_brick.utils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fee1939-c82a-4e8f-b731-f867c1418aa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b70588-523f-4afc-b12e-f58e1f5de0d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG os_brick.utils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e68f75-367c-48aa-a289-00d023d25d58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fca11c-23c6-4696-8a6d-c1cf5c1ef8d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07ce6f5-6979-4b2f-8679-a9d2d9e6000f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:38 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1697d-4af0-4fde-ba48-6c42f24b8649]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG os_brick.utils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updating existing volume attachment record: 5d72ebf4-936b-423b-86fe-47947dc855c1 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea2d57c-a433-432f-9bd0-4f5e82992915]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[254d97ac-54ed-4627-8d4c-b6d58b38030f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a9cbaf-7eba-4dcd-877d-e3eec8819985]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:14:39 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:14:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a9fe3-e29e-47c3-ad21-848752c65982]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG os_brick.utils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Updating existing volume attachment record: 1e2789ea-4b98-4602-9a56-dea420ad0c61 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:14:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-2ccbbedb-1c52-4361-8a4b-d692535a6c44 req-07598652-df7b-4bb3-8cf1-473a9497309e service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received event network-changed-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-2ccbbedb-1c52-4361-8a4b-d692535a6c44 req-07598652-df7b-4bb3-8cf1-473a9497309e service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Refreshing instance network info cache due to event network-changed-f928f8ba-850a-4a21-8553-ab2c3860c8a7. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2ccbbedb-1c52-4361-8a4b-d692535a6c44 req-07598652-df7b-4bb3-8cf1-473a9497309e service nova] Acquiring lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2ccbbedb-1c52-4361-8a4b-d692535a6c44 req-07598652-df7b-4bb3-8cf1-473a9497309e service nova] Acquired lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:42 user nova-compute[75017]: DEBUG nova.network.neutron [req-2ccbbedb-1c52-4361-8a4b-d692535a6c44 req-07598652-df7b-4bb3-8cf1-473a9497309e service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Refreshing network info cache for port f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:43 user nova-compute[75017]: DEBUG nova.network.neutron [req-2ccbbedb-1c52-4361-8a4b-d692535a6c44 req-07598652-df7b-4bb3-8cf1-473a9497309e service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Updated VIF entry in instance network info cache for port f928f8ba-850a-4a21-8553-ab2c3860c8a7. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:14:43 user nova-compute[75017]: DEBUG nova.network.neutron [req-2ccbbedb-1c52-4361-8a4b-d692535a6c44 req-07598652-df7b-4bb3-8cf1-473a9497309e service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Updating instance_info_cache with network_info: [{"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2ccbbedb-1c52-4361-8a4b-d692535a6c44 req-07598652-df7b-4bb3-8cf1-473a9497309e service nova] Releasing lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-6f780c0a-b8c9-4143-8876-d43f774515ea req-c0e0402a-4b92-48e1-982b-97a01b4626a6 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-changed-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-6f780c0a-b8c9-4143-8876-d43f774515ea req-c0e0402a-4b92-48e1-982b-97a01b4626a6 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Refreshing instance network info cache due to event network-changed-840e6749-42d0-4bb0-9787-a348ca450fe7. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6f780c0a-b8c9-4143-8876-d43f774515ea req-c0e0402a-4b92-48e1-982b-97a01b4626a6 service nova] Acquiring lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6f780c0a-b8c9-4143-8876-d43f774515ea req-c0e0402a-4b92-48e1-982b-97a01b4626a6 service nova] Acquired lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.network.neutron [req-6f780c0a-b8c9-4143-8876-d43f774515ea req-c0e0402a-4b92-48e1-982b-97a01b4626a6 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Refreshing network info cache for port 840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "interface-17969235-fc8b-4b25-995b-fdce8b496974-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "interface-17969235-fc8b-4b25-995b-fdce8b496974-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.objects.instance [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lazy-loading 'flavor' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.network.neutron [req-6f780c0a-b8c9-4143-8876-d43f774515ea req-c0e0402a-4b92-48e1-982b-97a01b4626a6 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updated VIF entry in instance network info cache for port 840e6749-42d0-4bb0-9787-a348ca450fe7. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.network.neutron [req-6f780c0a-b8c9-4143-8876-d43f774515ea req-c0e0402a-4b92-48e1-982b-97a01b4626a6 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updating instance_info_cache with network_info: [{"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6f780c0a-b8c9-4143-8876-d43f774515ea req-c0e0402a-4b92-48e1-982b-97a01b4626a6 service nova] Releasing lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.objects.instance [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lazy-loading 'pci_requests' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.objects.base [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Object Instance<17969235-fc8b-4b25-995b-fdce8b496974> lazy-loaded attributes: flavor,pci_requests {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:44 user nova-compute[75017]: DEBUG nova.policy [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72543d1c58b7444aa36e252b59f33625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbfa2cb0b7e442eb6a91f94df21dbe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:14:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Successfully created port: a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Successfully updated port: a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquired lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-2ef85dcc-a0f9-4552-bfc5-7237d7280601 req-12a5eecf-caba-4874-b256-352f6b41602e service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-changed-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-2ef85dcc-a0f9-4552-bfc5-7237d7280601 req-12a5eecf-caba-4874-b256-352f6b41602e service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Refreshing instance network info cache due to event network-changed-a09feea2-ad99-45ce-a6f3-4286f4f7e063. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2ef85dcc-a0f9-4552-bfc5-7237d7280601 req-12a5eecf-caba-4874-b256-352f6b41602e service nova] Acquiring lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updating instance_info_cache with network_info: [{"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Releasing lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2ef85dcc-a0f9-4552-bfc5-7237d7280601 req-12a5eecf-caba-4874-b256-352f6b41602e service nova] Acquired lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG nova.network.neutron [req-2ef85dcc-a0f9-4552-bfc5-7237d7280601 req-12a5eecf-caba-4874-b256-352f6b41602e service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Refreshing network info cache for port a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-57449668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-57449668',id=7,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISm4h9XE1KNjZ2BtaUqmuhfL1YRvfcyLbox2ZePi/EII8ogZ6S4AfZo+/2Z52igxxz2fW/Rx2pXwsmh/8mnYbXpfRpgYHTdJLGwxN4G2z5fHYm02Wr1qLrrUa0GrO3NaQ==',key_name='tempest-keypair-1815186852',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2cbfa2cb0b7e442eb6a91f94df21dbe0',ramdisk_id='',reservation_id='r-zhoyj2oj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2138896194',owner_user_name='tempest-TaggedAttachmentsTest-2138896194-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72543d1c58b7444aa36e252b59f33625',uuid=17969235-fc8b-4b25-995b-fdce8b496974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converting VIF {"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG os_vif [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0f15675-312c-5ea7-8f14-a3f102061e87', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa09feea2-ad, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:14:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa09feea2-ad, col_values=(('qos', UUID('15c43eca-a558-49a2-a634-980c59187e49')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa09feea2-ad, col_values=(('external_ids', {'iface-id': 'a09feea2-ad99-45ce-a6f3-4286f4f7e063', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:b2:26', 'vm-uuid': '17969235-fc8b-4b25-995b-fdce8b496974'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:47 user nova-compute[75017]: INFO os_vif [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad')
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-57449668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-57449668',id=7,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISm4h9XE1KNjZ2BtaUqmuhfL1YRvfcyLbox2ZePi/EII8ogZ6S4AfZo+/2Z52igxxz2fW/Rx2pXwsmh/8mnYbXpfRpgYHTdJLGwxN4G2z5fHYm02Wr1qLrrUa0GrO3NaQ==',key_name='tempest-keypair-1815186852',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2cbfa2cb0b7e442eb6a91f94df21dbe0',ramdisk_id='',reservation_id='r-zhoyj2oj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2138896194',owner_user_name='tempest-TaggedAttachmentsTest-2138896194-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72543d1c58b7444aa36e252b59f33625',uuid=17969235-fc8b-4b25-995b-fdce8b496974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converting VIF {"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] attach device xml: <interface type="ethernet">
Oct 30 09:14:47 user nova-compute[75017]:   <mac address="fa:16:3e:8c:b2:26"/>
Oct 30 09:14:47 user nova-compute[75017]:   <model type="virtio"/>
Oct 30 09:14:47 user nova-compute[75017]:   <mtu size="1442"/>
Oct 30 09:14:47 user nova-compute[75017]:   <target dev="tapa09feea2-ad"/>
Oct 30 09:14:47 user nova-compute[75017]: </interface>
Oct 30 09:14:47 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3c9e759-4614-49f1-82b1-ce997089db96 req-e1e9e6de-8475-4dda-8c3a-011aeaee5c7a service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-plugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3c9e759-4614-49f1-82b1-ce997089db96 req-e1e9e6de-8475-4dda-8c3a-011aeaee5c7a service nova] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3c9e759-4614-49f1-82b1-ce997089db96 req-e1e9e6de-8475-4dda-8c3a-011aeaee5c7a service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3c9e759-4614-49f1-82b1-ce997089db96 req-e1e9e6de-8475-4dda-8c3a-011aeaee5c7a service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3c9e759-4614-49f1-82b1-ce997089db96 req-e1e9e6de-8475-4dda-8c3a-011aeaee5c7a service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] No waiting events found dispatching network-vif-plugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:14:47 user nova-compute[75017]: WARNING nova.compute.manager [req-c3c9e759-4614-49f1-82b1-ce997089db96 req-e1e9e6de-8475-4dda-8c3a-011aeaee5c7a service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received unexpected event network-vif-plugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 for instance with vm_state active and task_state None.
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] No BDM found with device name hda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] No VIF found with MAC fa:16:3e:3a:5d:f7, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:14:47 user nova-compute[75017]:   <nova:package version="0.0.0"/>
Oct 30 09:14:47 user nova-compute[75017]:   <nova:name>tempest-device-tagging-server-57449668</nova:name>
Oct 30 09:14:47 user nova-compute[75017]:   <nova:creationTime>2023-10-30 09:14:47</nova:creationTime>
Oct 30 09:14:47 user nova-compute[75017]:   <nova:flavor name="m1.tiny">
Oct 30 09:14:47 user nova-compute[75017]:     <nova:memory>512</nova:memory>
Oct 30 09:14:47 user nova-compute[75017]:     <nova:disk>1</nova:disk>
Oct 30 09:14:47 user nova-compute[75017]:     <nova:swap>0</nova:swap>
Oct 30 09:14:47 user nova-compute[75017]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:14:47 user nova-compute[75017]:     <nova:vcpus>1</nova:vcpus>
Oct 30 09:14:47 user nova-compute[75017]:   </nova:flavor>
Oct 30 09:14:47 user nova-compute[75017]:   <nova:owner>
Oct 30 09:14:47 user nova-compute[75017]:     <nova:user uuid="72543d1c58b7444aa36e252b59f33625">tempest-TaggedAttachmentsTest-2138896194-project-member</nova:user>
Oct 30 09:14:47 user nova-compute[75017]:     <nova:project uuid="2cbfa2cb0b7e442eb6a91f94df21dbe0">tempest-TaggedAttachmentsTest-2138896194</nova:project>
Oct 30 09:14:47 user nova-compute[75017]:   </nova:owner>
Oct 30 09:14:47 user nova-compute[75017]:   <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:14:47 user nova-compute[75017]:   <nova:ports>
Oct 30 09:14:47 user nova-compute[75017]:     <nova:port uuid="840e6749-42d0-4bb0-9787-a348ca450fe7">
Oct 30 09:14:47 user nova-compute[75017]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:14:47 user nova-compute[75017]:     </nova:port>
Oct 30 09:14:47 user nova-compute[75017]:     <nova:port uuid="a09feea2-ad99-45ce-a6f3-4286f4f7e063">
Oct 30 09:14:47 user nova-compute[75017]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Oct 30 09:14:47 user nova-compute[75017]:     </nova:port>
Oct 30 09:14:47 user nova-compute[75017]:   </nova:ports>
Oct 30 09:14:47 user nova-compute[75017]: </nova:instance>
Oct 30 09:14:47 user nova-compute[75017]:  {{(pid=75017) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-65805355-8991-495a-afd1-1ef490b1f1f1 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "interface-17969235-fc8b-4b25-995b-fdce8b496974-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.912s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.network.neutron [req-2ef85dcc-a0f9-4552-bfc5-7237d7280601 req-12a5eecf-caba-4874-b256-352f6b41602e service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updated VIF entry in instance network info cache for port a09feea2-ad99-45ce-a6f3-4286f4f7e063. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG nova.network.neutron [req-2ef85dcc-a0f9-4552-bfc5-7237d7280601 req-12a5eecf-caba-4874-b256-352f6b41602e service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updating instance_info_cache with network_info: [{"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2ef85dcc-a0f9-4552-bfc5-7237d7280601 req-12a5eecf-caba-4874-b256-352f6b41602e service nova] Releasing lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-0e72b6bb-44fd-4401-9bfd-5cc05dd678ff req-e3070db9-b9aa-4d63-9430-2a8725eed15b service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-plugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0e72b6bb-44fd-4401-9bfd-5cc05dd678ff req-e3070db9-b9aa-4d63-9430-2a8725eed15b service nova] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0e72b6bb-44fd-4401-9bfd-5cc05dd678ff req-e3070db9-b9aa-4d63-9430-2a8725eed15b service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0e72b6bb-44fd-4401-9bfd-5cc05dd678ff req-e3070db9-b9aa-4d63-9430-2a8725eed15b service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-0e72b6bb-44fd-4401-9bfd-5cc05dd678ff req-e3070db9-b9aa-4d63-9430-2a8725eed15b service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] No waiting events found dispatching network-vif-plugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:14:49 user nova-compute[75017]: WARNING nova.compute.manager [req-0e72b6bb-44fd-4401-9bfd-5cc05dd678ff req-e3070db9-b9aa-4d63-9430-2a8725eed15b service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received unexpected event network-vif-plugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 for instance with vm_state active and task_state None.
Oct 30 09:14:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-7b448843-6a6d-4d68-84f4-71098102606f req-467ac12d-bf54-4973-a630-beb35e5660fc service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received event network-changed-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-7b448843-6a6d-4d68-84f4-71098102606f req-467ac12d-bf54-4973-a630-beb35e5660fc service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Refreshing instance network info cache due to event network-changed-206f4965-cf18-4bb3-a500-f5190b3ef833. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7b448843-6a6d-4d68-84f4-71098102606f req-467ac12d-bf54-4973-a630-beb35e5660fc service nova] Acquiring lock "refresh_cache-32e25927-79c3-490f-b53a-03d4a6299e42" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7b448843-6a6d-4d68-84f4-71098102606f req-467ac12d-bf54-4973-a630-beb35e5660fc service nova] Acquired lock "refresh_cache-32e25927-79c3-490f-b53a-03d4a6299e42" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG nova.network.neutron [req-7b448843-6a6d-4d68-84f4-71098102606f req-467ac12d-bf54-4973-a630-beb35e5660fc service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Refreshing network info cache for port 206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:14:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:50 user nova-compute[75017]: DEBUG nova.network.neutron [req-7b448843-6a6d-4d68-84f4-71098102606f req-467ac12d-bf54-4973-a630-beb35e5660fc service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Updated VIF entry in instance network info cache for port 206f4965-cf18-4bb3-a500-f5190b3ef833. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:14:50 user nova-compute[75017]: DEBUG nova.network.neutron [req-7b448843-6a6d-4d68-84f4-71098102606f req-467ac12d-bf54-4973-a630-beb35e5660fc service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Updating instance_info_cache with network_info: [{"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:14:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7b448843-6a6d-4d68-84f4-71098102606f req-467ac12d-bf54-4973-a630-beb35e5660fc service nova] Releasing lock "refresh_cache-32e25927-79c3-490f-b53a-03d4a6299e42" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:14:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPHbKkfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:14:58 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:14:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:14:58 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:14:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:14:58 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:14:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e436dc1-dae3-4aa6-9a29-2f038e4a9fd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:14:58 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f4c2ee-ae81-4251-bab5-8160f30ebe57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f] added
Oct 30 09:14:58 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d81298-9c56-4d71-acf3-6bbe622c1a77]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd65cc6-23f4-4bca-ba8a-3082165881d5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPHbKkfu {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPHbKkfu" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e571fb45-5d6d-4a08-8fab-13b8a57b3fbd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPHbKkfu'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[778e8295-3cf6-462f-95a8-0bf04f71b060]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.137s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d446242-70e1-4cb6-905c-5a8dc98be6ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:59 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:59 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb41825-186f-492a-b661-a4f72e759f91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f, portal: 172.16.0.220,3260]
Oct 30 09:14:59 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f, portal: 172.16.0.220,3260] successful.
Oct 30 09:14:59 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b2b1f-908a-4166-a7f3-177960c9b155]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2240fa-c516-49cf-b7c6-b5dab8d6bd3c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:59 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:14:59 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:14:59 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:14:59 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8377d-54b7-4e92-93ee-1ff268e892f4]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:14:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPHbKkfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23662346664363362', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662346664363362', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lazy-loading 'flavor' on Instance uuid 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:15:00 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:00 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:15:00 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:00 user nova-compute[75017]:   <serial>c3b080cd-4ffc-48c2-bd79-3dda74e60d4f</serial>
Oct 30 09:15:00 user nova-compute[75017]: </disk>
Oct 30 09:15:00 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] No VIF found with MAC fa:16:3e:00:96:2d, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vybCzndg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:01 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f767555-3d89-4533-9487-75b94ed1aa03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:15:01 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[36626904-6a14-4a14-b661-753d49be02ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339] added
Oct 30 09:15:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22a8058-0496-4752-a22e-64f4b67938eb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819e652-49fc-4439-bae8-6b854768a18c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vybCzndg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vybCzndg" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88841bf-eedf-4a94-8301-0e830d06414d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vybCzndg'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lazy-loading 'flavor' on Instance uuid df215875-673c-4446-afa1-3446ff63edbd {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[063bedcf-a363-4fff-9650-ca00632273f1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lazy-loading 'flavor' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[30320811-2405-4420-8a2d-d6da02985191]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:01 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:01 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG nova.objects.instance [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lazy-loading 'flavor' on Instance uuid 32e25927-79c3-490f-b53a-03d4a6299e42 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea22a80-312c-468b-8990-de2968431262]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339, portal: 172.16.0.220,3260]
Oct 30 09:15:01 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339, portal: 172.16.0.220,3260] successful.
Oct 30 09:15:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1dce4ce8-f789-411d-a74e-4dbb9b1f6ee6 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.040s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7050b435-6b1a-4810-90f4-6d044fa3473b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f05a9f6-7952-4a7e-98d9-b5a63a00e77d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:01 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:01 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:01 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:01 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbf1c25-8882-491b-8c40-b9e79a111c3b]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vybCzndg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:15:01 user nova-compute[75017]: INFO nova.virt.block_device [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Booting with volume 393d50bc-a569-4ca3-9fc0-d9fe061b5d4b at /dev/vdb
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:01 user nova-compute[75017]: INFO nova.compute.manager [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Attaching volume 44f7087a-5183-4876-8f2b-e1f87b452c3d to /dev/vdb
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:01 user nova-compute[75017]: INFO nova.compute.manager [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Attaching volume 12c3c341-bd46-4334-8dd5-732616fca671 to /dev/vdb
Oct 30 09:15:01 user nova-compute[75017]: DEBUG os_brick.utils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[df98de05-c1d7-4cbc-8152-a3ba50611210]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73d4e7-6185-4040-a023-9837f79d1004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bde2fb-9852-44cb-8d61-2b6c7a44d8db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7cfd50-72a6-405c-b141-3591f2ef0466]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:02 user nova-compute[75017]: INFO nova.compute.manager [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Attaching volume ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 to /dev/vdb
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:02 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b3e899-9a25-4a65-bfcc-7b70af37c5a5]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.utils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating existing volume attachment record: 5057b370-7e32-4482-9c5e-b2e5fa48b38a {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.utils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9e8a87-7ce1-4fcf-a78b-1fc67d8aadea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[274cb52b-8c00-4fa4-a451-a7993a7c2137]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9947c8a5-ee42-4f4c-876c-c4de4903cb44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bb751e-1c1e-45e8-a965-4705f7c70a1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.utils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.utils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:02 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5bdcb5-3be4-48fe-a565-1a713edc565b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[977e5504-3cc2-4292-b181-94043e46d5a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1e8473-6b7b-4d97-b073-0b6354b306a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.utils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Updating existing volume attachment record: f27fb292-04eb-4876-99d8-1360ac5ca641 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[398227af-a9e7-43d3-b323-99347ac44c37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab2b164-0e83-4d46-a7f0-1e6d7e63c0ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50820ad-055f-4c27-b390-983ac27c6ea6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a62e88c-73fc-4a48-9c11-91df826b88cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b5502d-4fa7-49f2-9ca5-3f809abac9b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e25c76b-0501-489a-9b42-6bc76db78f90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:02 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7a575f-d232-42b4-9275-5a665c262d4c]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.utils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Updating existing volume attachment record: 8d8093d4-01ef-4a52-8a73-0e851e446666 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:02 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:15:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[933e243f-274a-47ca-87f7-111accf248d1]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.utils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updating existing volume attachment record: 922d4264-dc0d-4abb-ba26-42a392dcd956 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26564376237353463', 'path': '/dev/sdd'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564376237353463', 'path': '/dev/sdd'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'flavor' on Instance uuid d46e94f6-465d-4112-868e-acf8cea4f402 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:15:02 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:02 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:15:02 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:02 user nova-compute[75017]:   <serial>5cdb7bf0-270f-433e-b323-88c35d27d339</serial>
Oct 30 09:15:02 user nova-compute[75017]: </disk>
Oct 30 09:15:02 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:15:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No VIF found with MAC fa:16:3e:c0:ef:8b, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:15:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:15:08 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:15:08 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:15:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:08 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:15:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:15:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:12 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:15:12 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7772MB free_disk=25.512367248535156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d46e94f6-465d-4112-868e-acf8cea4f402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 963c57ec-14d7-43c1-a8dc-7a062446a559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance df215875-673c-4446-afa1-3446ff63edbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 17969235-fc8b-4b25-995b-fdce8b496974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 32e25927-79c3-490f-b53a-03d4a6299e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5a294811-e03d-4034-871d-db6ba2ad721d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:15:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:15:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:15:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:15:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:15:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:15:13 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:15:14 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updating instance_info_cache with network_info: [{"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:15:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:15:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:15:14 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:15:14 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:15:14 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:15:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:15:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpRgncqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:20 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:20 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:20 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf2ab2-2e00-4f1d-a437-17312247bc5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:15:20 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e88bd7b-ca8f-4f6d-b4e9-9494a7d3ff05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c] added
Oct 30 09:15:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2885f823-c67f-4de5-a7f9-08d3149a6e02]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b4ec90-bc8d-437b-ab0e-318675565765]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpRgncqV {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpRgncqV" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d02f811-6848-4b12-ae4f-38de56e3ebf8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CpRgncqV'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c44782e-92a3-4725-ae21-64af81c0a5c7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea41e485-a8c3-4d9a-b3f5-1a537688aee1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db995c-85ea-495b-b241-02efe0da326b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c, portal: 172.16.0.220,3260]
Oct 30 09:15:20 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c, portal: 172.16.0.220,3260] successful.
Oct 30 09:15:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14695a6-e897-4988-82b9-fc3373484712]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a056377-59e3-4b6d-b8bf-0686b5d3801c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:20 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8381514a-4e38-44fc-82e6-a7dc8af39e4c]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:15:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpRgncqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23939356165643261', 'path': '/dev/sde'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939356165643261', 'path': '/dev/sde'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG nova.objects.instance [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lazy-loading 'flavor' on Instance uuid 963c57ec-14d7-43c1-a8dc-7a062446a559 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:15:22 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:22 user nova-compute[75017]:   <source dev="/dev/sde"/>
Oct 30 09:15:22 user nova-compute[75017]:   <target dev="sdc" bus="scsi"/>
Oct 30 09:15:22 user nova-compute[75017]:   <serial>6baad9d2-42f6-46c9-a5f4-bc8bee3a882c</serial>
Oct 30 09:15:22 user nova-compute[75017]:   <address type="drive" controller="0" unit="2"/>
Oct 30 09:15:22 user nova-compute[75017]: </disk>
Oct 30 09:15:22 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] No BDM found with device name sda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] No VIF found with MAC fa:16:3e:28:89:14, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ugEbaUGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:23 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:23 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:23 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc448a8-4f4a-4389-9dda-8971fd2f4861]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:15:23 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aff91d-3fb6-4ecb-9624-82345f90ac53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d] added
Oct 30 09:15:23 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ecf5a-9733-472e-9c1e-f63c12d5f4a8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1733f8-0d73-4da4-8001-5e462d34e64c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ugEbaUGR {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ugEbaUGR" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[90840df3-621c-4a0d-8718-71e4d0ea29db]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ugEbaUGR'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8f2007-226f-48ab-90c6-daa4ba9ec11a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bca99b9-115f-4f02-a90a-2af9926e0ba0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:23 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:23 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-110d892c-1840-4182-8276-c70a37e84795 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 62.821s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c65f9c-e4ae-454e-aa86-f355fc630d9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d, portal: 172.16.0.220,3260]
Oct 30 09:15:23 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d, portal: 172.16.0.220,3260] successful.
Oct 30 09:15:23 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0586f168-6bba-4b89-8376-327102c55722]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[05710bf8-3ac7-4f4f-944b-7cd5fbfd233d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:23 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:23 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:23 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e0c861-9aa3-45cd-a372-8e6fe46095e7]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:15:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ugEbaUGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-33c740f6-a1fa-4fd7-8402-66dcc117ed9e tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.482s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:24 user nova-compute[75017]: INFO nova.virt.block_device [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Booting with volume d5f577a2-5b80-4c55-a271-a20fa82fc6c1 at /dev/vdc
Oct 30 09:15:24 user nova-compute[75017]: DEBUG os_brick.utils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a73ab-0b3d-4806-a5d5-3c123566b8e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a7d920-8338-45e4-b7be-a05012a00280]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cbc65a-3bec-48ea-9409-19d921ce629b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39d524b-0516-4f6c-a796-de2ae5b2c81d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:24 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[384d745d-866e-4969-a501-d37b1a5f5cbe]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG os_brick.utils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating existing volume attachment record: 80c45a68-0e75-4abc-9b3c-2bfb451ef45b {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "8883aff3-715a-4c96-8969-e41986cad31b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "8883aff3-715a-4c96-8969-e41986cad31b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26532646532303466', 'path': '/dev/sdf'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532646532303466', 'path': '/dev/sdf'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:15:24 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lazy-loading 'flavor' on Instance uuid df215875-673c-4446-afa1-3446ff63edbd {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:15:25 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:25 user nova-compute[75017]:   <source dev="/dev/sdf"/>
Oct 30 09:15:25 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:25 user nova-compute[75017]:   <serial>44f7087a-5183-4876-8f2b-e1f87b452c3d</serial>
Oct 30 09:15:25 user nova-compute[75017]: </disk>
Oct 30 09:15:25 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:15:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:25 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:15:25 user nova-compute[75017]: INFO nova.compute.claims [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Claim successful on node user
Oct 30 09:15:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] No VIF found with MAC fa:16:3e:e7:80:5f, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-a829ee37-cc62-4c79-8470-8bcf46922a6e req-cc211f14-62b5-4c7f-9d6d-ba42102b29c1 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-changed-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-a829ee37-cc62-4c79-8470-8bcf46922a6e req-cc211f14-62b5-4c7f-9d6d-ba42102b29c1 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Refreshing instance network info cache due to event network-changed-0710ebd4-b142-4fec-b28f-338eced9e4c7. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a829ee37-cc62-4c79-8470-8bcf46922a6e req-cc211f14-62b5-4c7f-9d6d-ba42102b29c1 service nova] Acquiring lock "refresh_cache-5a294811-e03d-4034-871d-db6ba2ad721d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a829ee37-cc62-4c79-8470-8bcf46922a6e req-cc211f14-62b5-4c7f-9d6d-ba42102b29c1 service nova] Acquired lock "refresh_cache-5a294811-e03d-4034-871d-db6ba2ad721d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.network.neutron [req-a829ee37-cc62-4c79-8470-8bcf46922a6e req-cc211f14-62b5-4c7f-9d6d-ba42102b29c1 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Refreshing network info cache for port 0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.109s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:15:26 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.policy [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41bade78e9b24a15ab4016dc76a20931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd17cc193aa4827b94888db619cf93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:15:26 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Creating image(s)
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "/opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "/opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "/opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.029s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.network.neutron [req-a829ee37-cc62-4c79-8470-8bcf46922a6e req-cc211f14-62b5-4c7f-9d6d-ba42102b29c1 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Updated VIF entry in instance network info cache for port 0710ebd4-b142-4fec-b28f-338eced9e4c7. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG nova.network.neutron [req-a829ee37-cc62-4c79-8470-8bcf46922a6e req-cc211f14-62b5-4c7f-9d6d-ba42102b29c1 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Updating instance_info_cache with network_info: [{"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a829ee37-cc62-4c79-8470-8bcf46922a6e req-cc211f14-62b5-4c7f-9d6d-ba42102b29c1 service nova] Releasing lock "refresh_cache-5a294811-e03d-4034-871d-db6ba2ad721d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.244s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk 1073741824" returned: 0 in 0.055s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.198s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Cannot resize image /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Ensure instance console log exists: /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Successfully created port: 8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "2d49c6bb-acd9-4101-be6a-640a513e84ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:15:28 user nova-compute[75017]: INFO nova.compute.claims [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Claim successful on node user
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Successfully updated port: 8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "refresh_cache-8883aff3-715a-4c96-8969-e41986cad31b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquired lock "refresh_cache-8883aff3-715a-4c96-8969-e41986cad31b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-4b344de4-b562-4854-8fc8-8d9b1bb5e801 req-e4e18c72-7bfc-483d-a785-621d2bcf9514 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Received event network-changed-8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-4b344de4-b562-4854-8fc8-8d9b1bb5e801 req-e4e18c72-7bfc-483d-a785-621d2bcf9514 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Refreshing instance network info cache due to event network-changed-8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4b344de4-b562-4854-8fc8-8d9b1bb5e801 req-e4e18c72-7bfc-483d-a785-621d2bcf9514 service nova] Acquiring lock "refresh_cache-8883aff3-715a-4c96-8969-e41986cad31b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Updating instance_info_cache with network_info: [{"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Releasing lock "refresh_cache-8883aff3-715a-4c96-8969-e41986cad31b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Instance network_info: |[{"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4b344de4-b562-4854-8fc8-8d9b1bb5e801 req-e4e18c72-7bfc-483d-a785-621d2bcf9514 service nova] Acquired lock "refresh_cache-8883aff3-715a-4c96-8969-e41986cad31b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.neutron [req-4b344de4-b562-4854-8fc8-8d9b1bb5e801 req-e4e18c72-7bfc-483d-a785-621d2bcf9514 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Refreshing network info cache for port 8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Start _get_guest_xml network_info=[{"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:15:28 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:15:28 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2063575553',display_name='tempest-VolumesActionsTest-instance-2063575553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2063575553',id=11,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcd17cc193aa4827b94888db619cf93f',ramdisk_id='',reservation_id='r-0x6sk3zs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1324925892',owner_user_name='tempest-VolumesActionsTest-1324925892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:15:26Z,user_data=None,user_id='41bade78e9b24a15ab4016dc76a20931',uuid=8883aff3-715a-4c96-8969-e41986cad31b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converting VIF {"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0d:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c45b395-cc') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.objects.instance [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lazy-loading 'pci_devices' on Instance uuid 8883aff3-715a-4c96-8969-e41986cad31b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:15:28 user nova-compute[75017]:   <uuid>8883aff3-715a-4c96-8969-e41986cad31b</uuid>
Oct 30 09:15:28 user nova-compute[75017]:   <name>instance-0000000b</name>
Oct 30 09:15:28 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:15:28 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:15:28 user nova-compute[75017]:   <metadata>
Oct 30 09:15:28 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:15:28 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:15:28 user nova-compute[75017]:       <nova:name>tempest-VolumesActionsTest-instance-2063575553</nova:name>
Oct 30 09:15:28 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:15:28</nova:creationTime>
Oct 30 09:15:28 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:15:28 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:15:28 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:15:28 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:15:28 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:15:28 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:15:28 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:15:28 user nova-compute[75017]:       <nova:owner>
Oct 30 09:15:28 user nova-compute[75017]:         <nova:user uuid="41bade78e9b24a15ab4016dc76a20931">tempest-VolumesActionsTest-1324925892-project-member</nova:user>
Oct 30 09:15:28 user nova-compute[75017]:         <nova:project uuid="dcd17cc193aa4827b94888db619cf93f">tempest-VolumesActionsTest-1324925892</nova:project>
Oct 30 09:15:28 user nova-compute[75017]:       </nova:owner>
Oct 30 09:15:28 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:15:28 user nova-compute[75017]:       <nova:ports>
Oct 30 09:15:28 user nova-compute[75017]:         <nova:port uuid="8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0">
Oct 30 09:15:28 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 09:15:28 user nova-compute[75017]:         </nova:port>
Oct 30 09:15:28 user nova-compute[75017]:       </nova:ports>
Oct 30 09:15:28 user nova-compute[75017]:     </nova:instance>
Oct 30 09:15:28 user nova-compute[75017]:   </metadata>
Oct 30 09:15:28 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:15:28 user nova-compute[75017]:     <system>
Oct 30 09:15:28 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:15:28 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:15:28 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:15:28 user nova-compute[75017]:       <entry name="serial">8883aff3-715a-4c96-8969-e41986cad31b</entry>
Oct 30 09:15:28 user nova-compute[75017]:       <entry name="uuid">8883aff3-715a-4c96-8969-e41986cad31b</entry>
Oct 30 09:15:28 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:15:28 user nova-compute[75017]:     </system>
Oct 30 09:15:28 user nova-compute[75017]:   </sysinfo>
Oct 30 09:15:28 user nova-compute[75017]:   <os>
Oct 30 09:15:28 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:15:28 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:15:28 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:15:28 user nova-compute[75017]:   </os>
Oct 30 09:15:28 user nova-compute[75017]:   <features>
Oct 30 09:15:28 user nova-compute[75017]:     <acpi/>
Oct 30 09:15:28 user nova-compute[75017]:     <apic/>
Oct 30 09:15:28 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:15:28 user nova-compute[75017]:   </features>
Oct 30 09:15:28 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:15:28 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:15:28 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:15:28 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:15:28 user nova-compute[75017]:   </clock>
Oct 30 09:15:28 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:15:28 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:15:28 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:15:28 user nova-compute[75017]:   </cpu>
Oct 30 09:15:28 user nova-compute[75017]:   <devices>
Oct 30 09:15:28 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:15:28 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:15:28 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk"/>
Oct 30 09:15:28 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:15:28 user nova-compute[75017]:     </disk>
Oct 30 09:15:28 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:15:28 user nova-compute[75017]:       <mac address="fa:16:3e:4f:0d:e9"/>
Oct 30 09:15:28 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:28 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:15:28 user nova-compute[75017]:       <target dev="tap8c45b395-cc"/>
Oct 30 09:15:28 user nova-compute[75017]:     </interface>
Oct 30 09:15:28 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:15:28 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/console.log" append="off"/>
Oct 30 09:15:28 user nova-compute[75017]:     </serial>
Oct 30 09:15:28 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:15:28 user nova-compute[75017]:     <video>
Oct 30 09:15:28 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:28 user nova-compute[75017]:     </video>
Oct 30 09:15:28 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:15:28 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:15:28 user nova-compute[75017]:     </rng>
Oct 30 09:15:28 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:15:28 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:15:28 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:15:28 user nova-compute[75017]:     </memballoon>
Oct 30 09:15:28 user nova-compute[75017]:   </devices>
Oct 30 09:15:28 user nova-compute[75017]: </domain>
Oct 30 09:15:28 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2063575553',display_name='tempest-VolumesActionsTest-instance-2063575553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2063575553',id=11,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcd17cc193aa4827b94888db619cf93f',ramdisk_id='',reservation_id='r-0x6sk3zs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1324925892',owner_user_name='tempest-VolumesActionsTest-1324925892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:15:26Z,user_data=None,user_id='41bade78e9b24a15ab4016dc76a20931',uuid=8883aff3-715a-4c96-8969-e41986cad31b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converting VIF {"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0d:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c45b395-cc') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG os_vif [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0d:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c45b395-cc') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:15:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbcc5474-59a4-5fa4-855b-1c9336d4b762', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c45b395-cc, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c45b395-cc, col_values=(('qos', UUID('85b117c9-1f30-4efd-84e4-51021d3ecf0b')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c45b395-cc, col_values=(('external_ids', {'iface-id': '8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:0d:e9', 'vm-uuid': '8883aff3-715a-4c96-8969-e41986cad31b'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:29 user nova-compute[75017]: INFO os_vif [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0d:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c45b395-cc')
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.policy [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'edd9037b1ceb4b899f6d446b565a6ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4606fc32534a589e07baa3a4e76d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] No VIF found with MAC fa:16:3e:4f:0d:e9, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:15:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Creating image(s)
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "/opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "/opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.191s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-4b344de4-b562-4854-8fc8-8d9b1bb5e801 req-e4e18c72-7bfc-483d-a785-621d2bcf9514 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Updated VIF entry in instance network info cache for port 8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-4b344de4-b562-4854-8fc8-8d9b1bb5e801 req-e4e18c72-7bfc-483d-a785-621d2bcf9514 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Updating instance_info_cache with network_info: [{"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4b344de4-b562-4854-8fc8-8d9b1bb5e801 req-e4e18c72-7bfc-483d-a785-621d2bcf9514 service nova] Releasing lock "refresh_cache-8883aff3-715a-4c96-8969-e41986cad31b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk 1073741824" returned: 0 in 0.050s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Successfully created port: 813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Cannot resize image /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Ensure instance console log exists: /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Successfully updated port: 813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "refresh_cache-2d49c6bb-acd9-4101-be6a-640a513e84ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquired lock "refresh_cache-2d49c6bb-acd9-4101-be6a-640a513e84ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-36d8f3f9-eda9-4781-976f-7fc2badd7fe6 req-90d7e13e-6274-41fc-b2df-b1aed878925b service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received event network-changed-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-36d8f3f9-eda9-4781-976f-7fc2badd7fe6 req-90d7e13e-6274-41fc-b2df-b1aed878925b service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Refreshing instance network info cache due to event network-changed-813347a3-6dfb-4815-90a0-b2f57f1d197d. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36d8f3f9-eda9-4781-976f-7fc2badd7fe6 req-90d7e13e-6274-41fc-b2df-b1aed878925b service nova] Acquiring lock "refresh_cache-2d49c6bb-acd9-4101-be6a-640a513e84ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Updating instance_info_cache with network_info: [{"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Releasing lock "refresh_cache-2d49c6bb-acd9-4101-be6a-640a513e84ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Instance network_info: |[{"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36d8f3f9-eda9-4781-976f-7fc2badd7fe6 req-90d7e13e-6274-41fc-b2df-b1aed878925b service nova] Acquired lock "refresh_cache-2d49c6bb-acd9-4101-be6a-640a513e84ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-36d8f3f9-eda9-4781-976f-7fc2badd7fe6 req-90d7e13e-6274-41fc-b2df-b1aed878925b service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Refreshing network info cache for port 813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Start _get_guest_xml network_info=[{"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:15:30 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:15:30 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1660846650',display_name='tempest-AttachVolumeNegativeTest-server-1660846650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1660846650',id=12,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+gyRgRDH/nZsbFh2atpHlBnAfzATjGo9nEdaKWDgjLx1kgRnlZiwuA/zoAwc7o5uxZhcT6JkUp5PAS/PCsrqTliuYcIJuilicizUg68wQco6eb0HZyVudO14XT8kEyxw==',key_name='tempest-keypair-884677086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-c5gim7kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=2d49c6bb-acd9-4101-be6a-640a513e84ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=813347a3-6dfb-4815-90a0-b2f57f1d197d,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813347a3-6d') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d49c6bb-acd9-4101-be6a-640a513e84ab {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:15:30 user nova-compute[75017]:   <uuid>2d49c6bb-acd9-4101-be6a-640a513e84ab</uuid>
Oct 30 09:15:30 user nova-compute[75017]:   <name>instance-0000000c</name>
Oct 30 09:15:30 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:15:30 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:15:30 user nova-compute[75017]:   <metadata>
Oct 30 09:15:30 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:15:30 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:15:30 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1660846650</nova:name>
Oct 30 09:15:30 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:15:30</nova:creationTime>
Oct 30 09:15:30 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:15:30 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:15:30 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:15:30 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:15:30 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:15:30 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:15:30 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:15:30 user nova-compute[75017]:       <nova:owner>
Oct 30 09:15:30 user nova-compute[75017]:         <nova:user uuid="edd9037b1ceb4b899f6d446b565a6ff9">tempest-AttachVolumeNegativeTest-63898760-project-member</nova:user>
Oct 30 09:15:30 user nova-compute[75017]:         <nova:project uuid="2a4606fc32534a589e07baa3a4e76d48">tempest-AttachVolumeNegativeTest-63898760</nova:project>
Oct 30 09:15:30 user nova-compute[75017]:       </nova:owner>
Oct 30 09:15:30 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:15:30 user nova-compute[75017]:       <nova:ports>
Oct 30 09:15:30 user nova-compute[75017]:         <nova:port uuid="813347a3-6dfb-4815-90a0-b2f57f1d197d">
Oct 30 09:15:30 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:15:30 user nova-compute[75017]:         </nova:port>
Oct 30 09:15:30 user nova-compute[75017]:       </nova:ports>
Oct 30 09:15:30 user nova-compute[75017]:     </nova:instance>
Oct 30 09:15:30 user nova-compute[75017]:   </metadata>
Oct 30 09:15:30 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:15:30 user nova-compute[75017]:     <system>
Oct 30 09:15:30 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:15:30 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:15:30 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:15:30 user nova-compute[75017]:       <entry name="serial">2d49c6bb-acd9-4101-be6a-640a513e84ab</entry>
Oct 30 09:15:30 user nova-compute[75017]:       <entry name="uuid">2d49c6bb-acd9-4101-be6a-640a513e84ab</entry>
Oct 30 09:15:30 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:15:30 user nova-compute[75017]:     </system>
Oct 30 09:15:30 user nova-compute[75017]:   </sysinfo>
Oct 30 09:15:30 user nova-compute[75017]:   <os>
Oct 30 09:15:30 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:15:30 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:15:30 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:15:30 user nova-compute[75017]:   </os>
Oct 30 09:15:30 user nova-compute[75017]:   <features>
Oct 30 09:15:30 user nova-compute[75017]:     <acpi/>
Oct 30 09:15:30 user nova-compute[75017]:     <apic/>
Oct 30 09:15:30 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:15:30 user nova-compute[75017]:   </features>
Oct 30 09:15:30 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:15:30 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:15:30 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:15:30 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:15:30 user nova-compute[75017]:   </clock>
Oct 30 09:15:30 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:15:30 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:15:30 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:15:30 user nova-compute[75017]:   </cpu>
Oct 30 09:15:30 user nova-compute[75017]:   <devices>
Oct 30 09:15:30 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:15:30 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:15:30 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk"/>
Oct 30 09:15:30 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:15:30 user nova-compute[75017]:     </disk>
Oct 30 09:15:30 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:15:30 user nova-compute[75017]:       <mac address="fa:16:3e:1a:e1:3e"/>
Oct 30 09:15:30 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:30 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:15:30 user nova-compute[75017]:       <target dev="tap813347a3-6d"/>
Oct 30 09:15:30 user nova-compute[75017]:     </interface>
Oct 30 09:15:30 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:15:30 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/console.log" append="off"/>
Oct 30 09:15:30 user nova-compute[75017]:     </serial>
Oct 30 09:15:30 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:15:30 user nova-compute[75017]:     <video>
Oct 30 09:15:30 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:30 user nova-compute[75017]:     </video>
Oct 30 09:15:30 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:15:30 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:15:30 user nova-compute[75017]:     </rng>
Oct 30 09:15:30 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:15:30 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:15:30 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:15:30 user nova-compute[75017]:     </memballoon>
Oct 30 09:15:30 user nova-compute[75017]:   </devices>
Oct 30 09:15:30 user nova-compute[75017]: </domain>
Oct 30 09:15:30 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1660846650',display_name='tempest-AttachVolumeNegativeTest-server-1660846650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1660846650',id=12,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+gyRgRDH/nZsbFh2atpHlBnAfzATjGo9nEdaKWDgjLx1kgRnlZiwuA/zoAwc7o5uxZhcT6JkUp5PAS/PCsrqTliuYcIJuilicizUg68wQco6eb0HZyVudO14XT8kEyxw==',key_name='tempest-keypair-884677086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-c5gim7kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=2d49c6bb-acd9-4101-be6a-640a513e84ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=813347a3-6dfb-4815-90a0-b2f57f1d197d,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813347a3-6d') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG os_vif [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=813347a3-6dfb-4815-90a0-b2f57f1d197d,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813347a3-6d') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac8868dc-3118-5acf-b80f-b1dc4688609f', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap813347a3-6d, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap813347a3-6d, col_values=(('qos', UUID('fca60cf3-0e7e-4db1-b8bb-3fc650abf53f')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap813347a3-6d, col_values=(('external_ids', {'iface-id': '813347a3-6dfb-4815-90a0-b2f57f1d197d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:e1:3e', 'vm-uuid': '2d49c6bb-acd9-4101-be6a-640a513e84ab'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:31 user nova-compute[75017]: INFO os_vif [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=813347a3-6dfb-4815-90a0-b2f57f1d197d,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813347a3-6d')
Oct 30 09:15:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No VIF found with MAC fa:16:3e:1a:e1:3e, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-36d8f3f9-eda9-4781-976f-7fc2badd7fe6 req-90d7e13e-6274-41fc-b2df-b1aed878925b service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Updated VIF entry in instance network info cache for port 813347a3-6dfb-4815-90a0-b2f57f1d197d. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-36d8f3f9-eda9-4781-976f-7fc2badd7fe6 req-90d7e13e-6274-41fc-b2df-b1aed878925b service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Updating instance_info_cache with network_info: [{"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36d8f3f9-eda9-4781-976f-7fc2badd7fe6 req-90d7e13e-6274-41fc-b2df-b1aed878925b service nova] Releasing lock "refresh_cache-2d49c6bb-acd9-4101-be6a-640a513e84ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Received event network-vif-plugged-8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] Acquiring lock "8883aff3-715a-4c96-8969-e41986cad31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] Lock "8883aff3-715a-4c96-8969-e41986cad31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] Lock "8883aff3-715a-4c96-8969-e41986cad31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] No waiting events found dispatching network-vif-plugged-8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:32 user nova-compute[75017]: WARNING nova.compute.manager [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Received unexpected event network-vif-plugged-8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 for instance with vm_state building and task_state spawning.
Oct 30 09:15:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Received event network-vif-plugged-8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] Acquiring lock "8883aff3-715a-4c96-8969-e41986cad31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] Lock "8883aff3-715a-4c96-8969-e41986cad31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] Lock "8883aff3-715a-4c96-8969-e41986cad31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] No waiting events found dispatching network-vif-plugged-8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:32 user nova-compute[75017]: WARNING nova.compute.manager [req-5baff9b6-d843-444b-9c61-baaae3d440a7 req-18291ea8-c463-4bce-9546-aa9cc4bd2c10 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Received unexpected event network-vif-plugged-8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 for instance with vm_state building and task_state spawning.
Oct 30 09:15:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-ff892cdc-594d-4a09-81d2-f83ed42bfde4 req-f9a9f949-2673-49d4-820f-9d426212e576 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received event network-vif-plugged-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ff892cdc-594d-4a09-81d2-f83ed42bfde4 req-f9a9f949-2673-49d4-820f-9d426212e576 service nova] Acquiring lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ff892cdc-594d-4a09-81d2-f83ed42bfde4 req-f9a9f949-2673-49d4-820f-9d426212e576 service nova] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ff892cdc-594d-4a09-81d2-f83ed42bfde4 req-f9a9f949-2673-49d4-820f-9d426212e576 service nova] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-ff892cdc-594d-4a09-81d2-f83ed42bfde4 req-f9a9f949-2673-49d4-820f-9d426212e576 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] No waiting events found dispatching network-vif-plugged-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:32 user nova-compute[75017]: WARNING nova.compute.manager [req-ff892cdc-594d-4a09-81d2-f83ed42bfde4 req-f9a9f949-2673-49d4-820f-9d426212e576 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received unexpected event network-vif-plugged-813347a3-6dfb-4815-90a0-b2f57f1d197d for instance with vm_state building and task_state spawning.
Oct 30 09:15:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:15:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Instance spawned successfully.
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: INFO nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Took 7.95 seconds to spawn the instance on the hypervisor.
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:15:34 user nova-compute[75017]: INFO nova.compute.manager [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Took 9.55 seconds to build instance.
Oct 30 09:15:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8c152863-a934-4edb-8987-90c2e3ee15dc tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "8883aff3-715a-4c96-8969-e41986cad31b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.683s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:15:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Instance spawned successfully.
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-1ceb8363-58e6-48db-89f6-76dc2128dcf6 req-172df29d-f418-4d2c-ad84-6b79d87959a7 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received event network-vif-plugged-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1ceb8363-58e6-48db-89f6-76dc2128dcf6 req-172df29d-f418-4d2c-ad84-6b79d87959a7 service nova] Acquiring lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1ceb8363-58e6-48db-89f6-76dc2128dcf6 req-172df29d-f418-4d2c-ad84-6b79d87959a7 service nova] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1ceb8363-58e6-48db-89f6-76dc2128dcf6 req-172df29d-f418-4d2c-ad84-6b79d87959a7 service nova] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-1ceb8363-58e6-48db-89f6-76dc2128dcf6 req-172df29d-f418-4d2c-ad84-6b79d87959a7 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] No waiting events found dispatching network-vif-plugged-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:34 user nova-compute[75017]: WARNING nova.compute.manager [req-1ceb8363-58e6-48db-89f6-76dc2128dcf6 req-172df29d-f418-4d2c-ad84-6b79d87959a7 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received unexpected event network-vif-plugged-813347a3-6dfb-4815-90a0-b2f57f1d197d for instance with vm_state building and task_state spawning.
Oct 30 09:15:34 user nova-compute[75017]: INFO nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Took 5.73 seconds to spawn the instance on the hypervisor.
Oct 30 09:15:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:15:34 user nova-compute[75017]: INFO nova.compute.manager [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Took 6.53 seconds to build instance.
Oct 30 09:15:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4749b4a-0f69-41b0-b5b3-84bc03b8b06f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.645s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:15:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:15:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:15:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXoPhrCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:43 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:43 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:43 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb731da-5be5-446d-855a-6d4891c4e201]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:15:43 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6baf60b-2f31-47e2-9ab9-1a4c7d5a3911]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9] added
Oct 30 09:15:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e603e024-9bd6-4d64-ab2e-4d333454bf92]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc368f0-c11f-4374-af62-5b64c7463f10]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fXoPhrCi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fXoPhrCi" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0576150d-348e-4e5e-943f-8deea56bfcb5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fXoPhrCi'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ce6ef5-bb48-4c6f-a415-6494f77bb424]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed2629b-62eb-4d71-80dd-ff7c0775e5ca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:43 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:43 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:43 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:43 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:43 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:43 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:43 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:43 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[836da7ad-87f3-46f6-8ee8-21941332dec5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9, portal: 172.16.0.220,3260]
Oct 30 09:15:43 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9, portal: 172.16.0.220,3260] successful.
Oct 30 09:15:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0be954c-c11b-4a40-9b7b-d19cd92dcf49]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[350f772e-df31-4a51-9187-22d6639c6c50]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:44 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:44 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:44 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c31509e2-150c-458e-8313-2d9f6a63ef15 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.154s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[582cf9c0-3846-41ff-9ead-5d2d0e4e575b]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXoPhrCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:15:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23039643163643736', 'path': '/dev/sdg'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039643163643736', 'path': '/dev/sdg'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.objects.instance [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lazy-loading 'flavor' on Instance uuid 32e25927-79c3-490f-b53a-03d4a6299e42 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] attach device xml: <disk type="block" device="disk">
Oct 30 09:15:45 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:45 user nova-compute[75017]:   <source dev="/dev/sdg"/>
Oct 30 09:15:45 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:45 user nova-compute[75017]:   <serial>ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9</serial>
Oct 30 09:15:45 user nova-compute[75017]: </disk>
Oct 30 09:15:45 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:45 user nova-compute[75017]: INFO nova.compute.manager [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Detaching volume c3b080cd-4ffc-48c2-bd79-3dda74e60d4f
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] No VIF found with MAC fa:16:3e:82:b1:c5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:45 user nova-compute[75017]: INFO nova.compute.manager [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Rebuilding instance
Oct 30 09:15:45 user nova-compute[75017]: INFO nova.virt.block_device [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Attempting to driver detach volume c3b080cd-4ffc-48c2-bd79-3dda74e60d4f from mountpoint /dev/vdb
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Attempting to detach device vdb from instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:15:45 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:45 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:15:45 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:45 user nova-compute[75017]:   <serial>c3b080cd-4ffc-48c2-bd79-3dda74e60d4f</serial>
Oct 30 09:15:45 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:15:45 user nova-compute[75017]: </disk>
Oct 30 09:15:45 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:15:45 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Successfully detached device vdb from instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 from the persistent domain config.
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:15:45 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:45 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:15:45 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:45 user nova-compute[75017]:   <serial>c3b080cd-4ffc-48c2-bd79-3dda74e60d4f</serial>
Oct 30 09:15:45 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:15:45 user nova-compute[75017]: </disk>
Oct 30 09:15:45 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "963c57ec-14d7-43c1-a8dc-7a062446a559" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:45 user nova-compute[75017]: INFO nova.compute.manager [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Detaching volume 6baad9d2-42f6-46c9-a5f4-bc8bee3a882c
Oct 30 09:15:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-47fda211-b49c-4863-ab58-d236b02578c9 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.887s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-552f679f-512b-4ba9-a1a6-9463583451c3 req-610a6eed-0896-471c-aaf8-e5e51eb22dec service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-unplugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-552f679f-512b-4ba9-a1a6-9463583451c3 req-610a6eed-0896-471c-aaf8-e5e51eb22dec service nova] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-552f679f-512b-4ba9-a1a6-9463583451c3 req-610a6eed-0896-471c-aaf8-e5e51eb22dec service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-552f679f-512b-4ba9-a1a6-9463583451c3 req-610a6eed-0896-471c-aaf8-e5e51eb22dec service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-552f679f-512b-4ba9-a1a6-9463583451c3 req-610a6eed-0896-471c-aaf8-e5e51eb22dec service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] No waiting events found dispatching network-vif-unplugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:46 user nova-compute[75017]: WARNING nova.compute.manager [req-552f679f-512b-4ba9-a1a6-9463583451c3 req-610a6eed-0896-471c-aaf8-e5e51eb22dec service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received unexpected event network-vif-unplugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 for instance with vm_state active and task_state rebuilding.
Oct 30 09:15:46 user nova-compute[75017]: INFO nova.virt.block_device [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Attempting to driver detach volume 6baad9d2-42f6-46c9-a5f4-bc8bee3a882c from mountpoint /dev/sdc
Oct 30 09:15:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Attempting to detach device sdc from instance 963c57ec-14d7-43c1-a8dc-7a062446a559 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:15:46 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:46 user nova-compute[75017]:   <source dev="/dev/sde"/>
Oct 30 09:15:46 user nova-compute[75017]:   <target dev="sdc" bus="scsi"/>
Oct 30 09:15:46 user nova-compute[75017]:   <serial>6baad9d2-42f6-46c9-a5f4-bc8bee3a882c</serial>
Oct 30 09:15:46 user nova-compute[75017]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 30 09:15:46 user nova-compute[75017]: </disk>
Oct 30 09:15:46 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:15:46 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Successfully detached device sdc from instance 963c57ec-14d7-43c1-a8dc-7a062446a559 from the persistent domain config.
Oct 30 09:15:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 963c57ec-14d7-43c1-a8dc-7a062446a559 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:15:46 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:46 user nova-compute[75017]:   <source dev="/dev/sde"/>
Oct 30 09:15:46 user nova-compute[75017]:   <target dev="sdc" bus="scsi"/>
Oct 30 09:15:46 user nova-compute[75017]:   <serial>6baad9d2-42f6-46c9-a5f4-bc8bee3a882c</serial>
Oct 30 09:15:46 user nova-compute[75017]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 30 09:15:46 user nova-compute[75017]: </disk>
Oct 30 09:15:46 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEHvdDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:46 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:46 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:46 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[96490d0a-156b-4aa4-9e98-d5afb4f1ae6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:15:46 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0c5e01-9f5a-4fe7-b4b9-21098b7f4aba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671] added
Oct 30 09:15:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[90af832c-5c1d-4516-9f79-907f4715ba95]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4eed7f-3a35-457a-a058-1701d7dc1fae]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEHvdDBP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEHvdDBP" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[969a5826-ac7e-43f1-8c44-7a59d8e79006]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sEHvdDBP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] Lock "df215875-673c-4446-afa1-3446ff63edbd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.utils [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e23674-ba8a-4949-99da-6508fb748e1d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b7d342-b4f7-4046-8ec5-3e947bccb38e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3192ec7d-190a-4547-8d35-1e346f064d88]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4c4ed9-bc2a-46e1-abc9-2e939fe32079]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[545a273d-8964-47c7-862e-a2818a8bccab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9df95e4-d8df-43c7-8840-0b4a86354a7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7d86b17-d99b-4c84-a1a0-bcd9188d0f00 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] volume_snapshot_create: create_info: {'snapshot_id': '7a0a37fe-2e21-4c07-9e82-8de046174451', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75017) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0be1bb1-0a8e-4a9c-aa17-0917a19d8661]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671, portal: 172.16.0.220,3260]
Oct 30 09:15:47 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671, portal: 172.16.0.220,3260] successful.
Oct 30 09:15:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:15:47 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[911072d3-94e0-4e9b-9512-365309454262]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.utils [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 963c57ec-14d7-43c1-a8dc-7a062446a559 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7d86b17-d99b-4c84-a1a0-bcd9188d0f00 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] snap xml: <domainsnapshot>
Oct 30 09:15:47 user nova-compute[75017]:   <disks>
Oct 30 09:15:47 user nova-compute[75017]:     <disk name="/dev/sdg" snapshot="external" type="file">
Oct 30 09:15:47 user nova-compute[75017]:       <source file="/dev/new_file"/>
Oct 30 09:15:47 user nova-compute[75017]:     </disk>
Oct 30 09:15:47 user nova-compute[75017]:     <disk name="vda" snapshot="no"/>
Oct 30 09:15:47 user nova-compute[75017]:   </disks>
Oct 30 09:15:47 user nova-compute[75017]: </domainsnapshot>
Oct 30 09:15:47 user nova-compute[75017]:  {{(pid=75017) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b7d86b17-d99b-4c84-a1a0-bcd9188d0f00 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] Lazy-loading 'system_metadata' on Instance uuid 32e25927-79c3-490f-b53a-03d4a6299e42 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b332fb-604e-4b14-b1ec-542b333b656a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance destroyed successfully.
Oct 30 09:15:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance destroyed successfully.
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1298966713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336386316',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK41I5D09IEItrwBGv57T/9QpZ4xvfrikmugxYqYCeOgq36dju7nfyqi8IgYaIAFEzcXXx+7C1Q8g3cHSKYsfkHntXkvMk131KHuB14YNxNDJqfZXdzIIjjyJdTTefyNRA==',key_name='tempest-keypair-1967695828',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='734c9139fffd4605a81e382a6b54a0e6',ramdisk_id='',reservation_id='r-takylgq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1641318212',owner_user_name='tempest-ServerActionsV293TestJSON-1641318212-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f08150a4aa4eff90af699ccc61d4e5',uuid=5a294811-e03d-4034-871d-db6ba2ad721d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converting VIF {"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_vif [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8808a067-5a8f-452f-8449-c38b1fd34827]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.463s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0710ebd4-b1, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b7d86b17-d99b-4c84-a1a0-bcd9188d0f00 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948ed14-113a-45b7-81a2-7572b2706b39]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f645731a-b406-46aa-b57b-59a0497cca89 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] volume_snapshot_delete: delete_info: {'volume_id': 'ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9'} {{(pid=75017) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [None req-f645731a-b406-46aa-b57b-59a0497cca89 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     if delete_info['type'] != 'qcow2':
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] KeyError: 'type'
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [None req-b7d86b17-d99b-4c84-a1a0-bcd9188d0f00 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     rv = execute(f, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     six.reraise(c, e, tb)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     raise value
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     rv = meth(*args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [None req-b7d86b17-d99b-4c84-a1a0-bcd9188d0f00 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     self._volume_snapshot_create(context, instance, guest,
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     rv = execute(f, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     six.reraise(c, e, tb)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     raise value
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     rv = meth(*args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] 
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEHvdDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:15:47 user nova-compute[75017]: INFO nova.compute.manager [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] [instance: df215875-673c-4446-afa1-3446ff63edbd] Swapping volume 44f7087a-5183-4876-8f2b-e1f87b452c3d for fddfd213-19f4-4c05-aaa9-eb30d7df599e
Oct 30 09:15:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97d0ac93-73cc-49fa-96a4-e43544596c3e) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:47 user nova-compute[75017]: INFO os_vif [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1')
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoyQnSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:47 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 09:15:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [None req-f645731a-b406-46aa-b57b-59a0497cca89 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e61c5f6a-9689-4ccb-a6b2-9f191218d85c)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server [None req-f645731a-b406-46aa-b57b-59a0497cca89 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] Exception during message handling: KeyError: 'type'
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver [None req-b7d86b17-d99b-4c84-a1a0-bcd9188d0f00 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 7a0a37fe-2e21-4c07-9e82-8de046174451 could not be found.
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     raise value
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 7a0a37fe-2e21-4c07-9e82-8de046174451 could not be found. (HTTP 404) (Request-ID: req-55bff5af-5115-4987-82ee-6bcc4a906ab4)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 7a0a37fe-2e21-4c07-9e82-8de046174451 could not be found.
Oct 30 09:15:47 user nova-compute[75017]: ERROR nova.virt.libvirt.driver 
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server [None req-b7d86b17-d99b-4c84-a1a0-bcd9188d0f00 tempest-VolumesAssistedSnapshotsTest-2126767737 tempest-VolumesAssistedSnapshotsTest-2126767737-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise value
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 09:15:47 user nova-compute[75017]: ERROR oslo_messaging.rpc.server 
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:47 user nova-compute[75017]: INFO nova.compute.manager [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Detaching volume ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9
Oct 30 09:15:47 user nova-compute[75017]: INFO nova.virt.block_device [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Attempting to driver detach volume ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 from mountpoint /dev/vdb
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Attempting to detach device vdb from instance 32e25927-79c3-490f-b53a-03d4a6299e42 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] detach device xml: <disk type="block" device="disk">
Oct 30 09:15:47 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:47 user nova-compute[75017]:   <source dev="/dev/sdg"/>
Oct 30 09:15:47 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:47 user nova-compute[75017]:   <serial>ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9</serial>
Oct 30 09:15:47 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:15:47 user nova-compute[75017]: </disk>
Oct 30 09:15:47 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:15:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Successfully detached device vdb from instance 32e25927-79c3-490f-b53a-03d4a6299e42 from the persistent domain config.
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 32e25927-79c3-490f-b53a-03d4a6299e42 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:15:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] detach device xml: <disk type="block" device="disk">
Oct 30 09:15:47 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:47 user nova-compute[75017]:   <source dev="/dev/sdg"/>
Oct 30 09:15:47 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:47 user nova-compute[75017]:   <serial>ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9</serial>
Oct 30 09:15:47 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:15:47 user nova-compute[75017]: </disk>
Oct 30 09:15:47 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 32e25927-79c3-490f-b53a-03d4a6299e42 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.610s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] <== connect_volume: return (1613ms) {'type': 'block', 'scsi_wwn': '23236626563316433', 'path': '/dev/sdh'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236626563316433', 'path': '/dev/sdh'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.969s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lazy-loading 'flavor' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:15:48 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:48 user nova-compute[75017]:   <source dev="/dev/sdh"/>
Oct 30 09:15:48 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:48 user nova-compute[75017]:   <serial>12c3c341-bd46-4334-8dd5-732616fca671</serial>
Oct 30 09:15:48 user nova-compute[75017]: </disk>
Oct 30 09:15:48 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eee581-221f-40c5-a005-dd7e6871d09d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:15:48 user nova-compute[75017]: No targets found.
Oct 30 09:15:48 user nova-compute[75017]: iSNS:
Oct 30 09:15:48 user nova-compute[75017]: No targets found.
Oct 30 09:15:48 user nova-compute[75017]: STATIC:
Oct 30 09:15:48 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c
Oct 30 09:15:48 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:48 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:48 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f
Oct 30 09:15:48 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:48 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:48 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9
Oct 30 09:15:48 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:48 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:48 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671
Oct 30 09:15:48 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:48 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:48 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:15:48 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:48 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:48 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:15:48 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:48 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:48 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244
Oct 30 09:15:48 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:48 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:48 user nova-compute[75017]: FIRMWARE:
Oct 30 09:15:48 user nova-compute[75017]: No targets found.
Oct 30 09:15:48 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:15:48 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:15:48 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5855064-1689-48a0-a7c7-47d41b0018ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db7d8f8-02e8-49bd-8140-44fb7ec0bf25]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:48 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:48 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:48 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d1012f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[541a0e79-9a15-4589-9a0e-f1a49c78a837]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-cad612d1-3ae2-4205-9464-5010ad8e805d req-526331c6-f82c-4353-8b2e-f03872e054d7 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cad612d1-3ae2-4205-9464-5010ad8e805d req-526331c6-f82c-4353-8b2e-f03872e054d7 service nova] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cad612d1-3ae2-4205-9464-5010ad8e805d req-526331c6-f82c-4353-8b2e-f03872e054d7 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cad612d1-3ae2-4205-9464-5010ad8e805d req-526331c6-f82c-4353-8b2e-f03872e054d7 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-cad612d1-3ae2-4205-9464-5010ad8e805d req-526331c6-f82c-4353-8b2e-f03872e054d7 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] No waiting events found dispatching network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:48 user nova-compute[75017]: WARNING nova.compute.manager [req-cad612d1-3ae2-4205-9464-5010ad8e805d req-526331c6-f82c-4353-8b2e-f03872e054d7 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received unexpected event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 for instance with vm_state active and task_state rebuilding.
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.039s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a210860-e508-49a1-b2da-843aaa53f1d9]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94bec54-e7b8-476e-a898-f8ff50b2d29e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e701b5d9-8c87-45b9-8d31-2154a85414fd]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5732309-b0ce-4eed-91e8-515bfa328457]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b118dab0-e217-4bb9-8875-de9c9607a759]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260]
Oct 30 09:15:48 user nova-compute[75017]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260] successful.
Oct 30 09:15:48 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e743fca8-7e67-405a-801f-354e16aed7d5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] <== disconnect_volume: return (1417ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:15:48 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Deleting instance files /opt/stack/data/nova/instances/5a294811-e03d-4034-871d-db6ba2ad721d_del
Oct 30 09:15:48 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Deletion of /opt/stack/data/nova/instances/5a294811-e03d-4034-871d-db6ba2ad721d_del complete
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] No BDM found with device name hda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] No VIF found with MAC fa:16:3e:3a:5d:f7, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b33eb80-e79e-42e1-a640-a589426c3173 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.121s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:49 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 5a294811-e03d-4034-871d-db6ba2ad721d could not be found.
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoyQnSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:49 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d4656d-cff3-484b-ae86-52114aaf2fb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:15:49 user nova-compute[75017]: No targets found.
Oct 30 09:15:49 user nova-compute[75017]: iSNS:
Oct 30 09:15:49 user nova-compute[75017]: No targets found.
Oct 30 09:15:49 user nova-compute[75017]: STATIC:
Oct 30 09:15:49 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c
Oct 30 09:15:49 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:49 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:49 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f
Oct 30 09:15:49 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:49 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:49 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9
Oct 30 09:15:49 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:49 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:49 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671
Oct 30 09:15:49 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:49 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:49 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:15:49 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:49 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:49 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:15:49 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:15:49 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:15:49 user nova-compute[75017]: FIRMWARE:
Oct 30 09:15:49 user nova-compute[75017]: No targets found.
Oct 30 09:15:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:15:49 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:15:49 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49bd4e2-0560-41b8-bb4c-54ed60d39e94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7082d1-e4e9-43bf-83ef-5bf08e855d4b]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccebb370>, {}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Disconnecting from: [] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] <== disconnect_volume: return (82ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:15:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Creating image(s)
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Ensure instance console log exists: /opt/stack/data/nova/instances/e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Start _get_guest_xml network_info=[{"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRXvIBxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9', 'attached_at': '', 'detached_at': '', 'volume_id': '90ad41d5-afce-494c-b728-29ade5213a78', 'serial': '90ad41d5-afce-494c-b728-29ade5213a78'}, 'disk_bus': 'virtio', 'attachment_id': '0af2db08-904e-42e6-a5ca-c687f706867a', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHKcWlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9', 'attached_at': '', 'detached_at': '', 'volume_id': '393d50bc-a569-4ca3-9fc0-d9fe061b5d4b', 'serial': '393d50bc-a569-4ca3-9fc0-d9fe061b5d4b'}, 'disk_bus': 'virtio', 'attachment_id': '5057b370-7e32-4482-9c5e-b2e5fa48b38a', 'mount_device': '/dev/vdb', 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDsgbqWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5f577a2-5b80-4c55-a271-a20fa82fc6c1', 'serial': 'd5f577a2-5b80-4c55-a271-a20fa82fc6c1'}, 'disk_bus': 'virtio', 'attachment_id': '80c45a68-0e75-4abc-9b3c-2bfb451ef45b', 'mount_device': '/dev/vdc', 'boot_index': 2, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:15:49 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:15:49 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRXvIBxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:49 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:49 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:49 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15e7dd0-84b9-4b11-bc35-cc6056c80738]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:15:49 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1cd624-bd3a-4b04-a48c-9503bbfe723a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78] added
Oct 30 09:15:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd837b76-2a7e-4b14-a141-cf6f0aee8221]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[16661199-de2f-4698-96cf-bfc522b2860e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRXvIBxZ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRXvIBxZ" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb9f0a0-6181-4fd6-b8cc-4fa4077c042b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DRXvIBxZ'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d63768-74de-4810-b638-f2c4816e921e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4db0c5-d280-41e3-a49b-a11c479096d9]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2511e1-9e3a-46ad-b56d-e4f9e719be0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78, portal: 172.16.0.220,3260]
Oct 30 09:15:49 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78, portal: 172.16.0.220,3260] successful.
Oct 30 09:15:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b378553-6be7-404e-9720-32fb5a38370c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1f65f-f231-455d-9379-eaff93880da0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eccc3b-3b1b-40ae-93e1-21256b42eed3]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:15:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRXvIBxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.volume.cinder [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] Update attachment failed for attachment a6a18739-8ebc-4aaa-a03e-daf56464b5d2. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9fee4b83-f8da-499d-ad4b-619eac06ed41) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9fee4b83-f8da-499d-ad4b-619eac06ed41)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] [instance: df215875-673c-4446-afa1-3446ff63edbd] Failed to connect to volume fddfd213-19f4-4c05-aaa9-eb30d7df599e with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9fee4b83-f8da-499d-ad4b-619eac06ed41)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd] Traceback (most recent call last):
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     new_cinfo = self.volume_api.attachment_update(
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     res = method(self, ctx, *args, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     with excutils.save_and_reraise_exception():
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     self.force_reraise()
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     raise self.value
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     context, '3.44', skip_version_check=True).attachments.update(
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     return method.func(obj, *args, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     resp = self._update('/attachments/%s' % id, body)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     return self._cs_request(url, 'PUT', **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     return self.request(url, method, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd]     raise exceptions.from_response(resp, body)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9fee4b83-f8da-499d-ad4b-619eac06ed41)
Oct 30 09:15:49 user nova-compute[75017]: ERROR nova.compute.manager [instance: df215875-673c-4446-afa1-3446ff63edbd] 
Oct 30 09:15:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] Lock "df215875-673c-4446-afa1-3446ff63edbd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 2.831s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server [None req-7aeaed9a-4f5c-4112-9d80-3ef3ccd90bd3 tempest-TestVolumeSwap-232440350 tempest-TestVolumeSwap-232440350-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9fee4b83-f8da-499d-ad4b-619eac06ed41)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7902, in swap_volume
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7900, in _do_locked_swap_volume
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7944, in _do_swap_volume
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7793, in _swap_volume
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9fee4b83-f8da-499d-ad4b-619eac06ed41)
Oct 30 09:15:49 user nova-compute[75017]: ERROR oslo_messaging.rpc.server 
Oct 30 09:15:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Preparing to wait for external event volume-reimaged-3a9871b3-cec4-447d-89c0-aa4d20fa3244 {{(pid=75017) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:50 user nova-compute[75017]: INFO nova.compute.manager [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Detaching volume 12c3c341-bd46-4334-8dd5-732616fca671
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23263353334313735', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263353334313735', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHKcWlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:50 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:50 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:50 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:15:50 user nova-compute[75017]: INFO nova.virt.block_device [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Attempting to driver detach volume 12c3c341-bd46-4334-8dd5-732616fca671 from mountpoint /dev/vdb
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Attempting to detach device vdb from instance 17969235-fc8b-4b25-995b-fdce8b496974 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:15:50 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:50 user nova-compute[75017]:   <source dev="/dev/sdh"/>
Oct 30 09:15:50 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:50 user nova-compute[75017]:   <serial>12c3c341-bd46-4334-8dd5-732616fca671</serial>
Oct 30 09:15:50 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 09:15:50 user nova-compute[75017]: </disk>
Oct 30 09:15:50 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d357b526-c3fd-4313-84dd-2959a8235db5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:15:50 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Successfully detached device vdb from instance 17969235-fc8b-4b25-995b-fdce8b496974 from the persistent domain config.
Oct 30 09:15:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17969235-fc8b-4b25-995b-fdce8b496974 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:15:50 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:50 user nova-compute[75017]:   <source dev="/dev/sdh"/>
Oct 30 09:15:50 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:15:50 user nova-compute[75017]:   <serial>12c3c341-bd46-4334-8dd5-732616fca671</serial>
Oct 30 09:15:50 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 09:15:50 user nova-compute[75017]: </disk>
Oct 30 09:15:50 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[607f9b69-5d2d-4b09-a440-fd1428b71a9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b] added
Oct 30 09:15:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53c6e88-7747-4a1e-9ee9-67e3a6c9b86f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a6f06c-49da-417a-bfeb-7f7ce31d488a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TIHKcWlV {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TIHKcWlV" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6b07fe-7ae3-4efe-aefe-2fbb4971a9d2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TIHKcWlV'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[269ab61e-cf50-4d58-837d-4142f104cb87]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a167b7e2-d661-4b3f-9e12-53a5b7cca404]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b78dc6a-d655-44ab-8695-7b48ad827b67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b, portal: 172.16.0.220,3260]
Oct 30 09:15:50 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b, portal: 172.16.0.220,3260] successful.
Oct 30 09:15:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdb6143-eee3-4dae-bed9-429fb9f5b1bd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3a23ec-81c6-464e-901f-4694a422863d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:15:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffa267d-67e4-409e-bf44-9a850890b76e]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:15:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHKcWlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:15:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23464323335623639', 'path': '/dev/sdi'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464323335623639', 'path': '/dev/sdi'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDsgbqWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:15:52 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:52 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:15:52 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[35800625-4fbf-4337-895d-79db971f641f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:15:52 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07eca7e-00e4-4cb8-b8bf-f612fb9baebc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1] added
Oct 30 09:15:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff48bb0-6426-486a-8508-cf47ccac5c51]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[708613c7-d842-497e-b763-106dda927d04]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FDsgbqWO {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FDsgbqWO" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c383f743-ea50-48af-a588-fb35caf57c50]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FDsgbqWO'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d041c8-073b-4c51-99db-eb54ba260aa2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef4177b-1676-4018-a08f-d8ef4a3b499d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4430cc4d-d1b8-48bc-bc10-bcfcf178f23c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1, portal: 172.16.0.220,3260]
Oct 30 09:15:52 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1, portal: 172.16.0.220,3260] successful.
Oct 30 09:15:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a18aaa1-84a1-4ad2-8d00-f373bb87c85e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[00759368-c1c5-4f12-917e-0f17a504d4a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:15:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40bfb1f-0a56-4627-9054-1772ca6b6288]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDsgbqWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:15:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23237353731656636', 'path': '/dev/sdj'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237353731656636', 'path': '/dev/sdj'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:08,bridge_name='br-int',has_traffic_filtering=True,id=c75be99b-5a95-4330-acbb-12f982a1c492,network=Network(3ead5234-8276-41ed-b788-f2ebf3724feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75be99b-5a') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2c:4d,bridge_name='br-int',has_traffic_filtering=True,id=8bf40fff-eeab-4a60-ae57-e3229ebac120,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bf40fff-ee') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:8a,bridge_name='br-int',has_traffic_filtering=True,id=288a1cda-73d5-4222-a7a9-5657efaa45da,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap288a1cda-73') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:5b:ce,bridge_name='br-int',has_traffic_filtering=True,id=49e4404a-1322-473f-bb99-9ba80c17d01f,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e4404a-13') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:be:36,bridge_name='br-int',has_traffic_filtering=True,id=e924d1fa-1e09-4b03-a940-0408f564be1e,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape924d1fa-1e') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:19,bridge_name='br-int',has_traffic_filtering=True,id=6009b5bc-376f-4b61-8e1c-b0bb4864c686,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009b5bc-37') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0f83c4e-90a4-46d9-852a-91a732e2fdde,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f83c4e-90') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lazy-loading 'pci_devices' on Instance uuid e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:15:53 user nova-compute[75017]:   <uuid>e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9</uuid>
Oct 30 09:15:53 user nova-compute[75017]:   <name>instance-0000000a</name>
Oct 30 09:15:53 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:15:53 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:15:53 user nova-compute[75017]:   <metadata>
Oct 30 09:15:53 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:15:53 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:15:53 user nova-compute[75017]:       <nova:name>tempest-device-tagging-server-1320251861</nova:name>
Oct 30 09:15:53 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:15:49</nova:creationTime>
Oct 30 09:15:53 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:15:53 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:15:53 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:15:53 user nova-compute[75017]:       <nova:owner>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:user uuid="e4b6d1aed2074fa7a74256a8764b44bc">tempest-TaggedBootDevicesTest_v242-1474711768-project-member</nova:user>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:project uuid="4965ad5176314c298c0e1ce3cf0995f4">tempest-TaggedBootDevicesTest_v242-1474711768</nova:project>
Oct 30 09:15:53 user nova-compute[75017]:       </nova:owner>
Oct 30 09:15:53 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:15:53 user nova-compute[75017]:       <nova:ports>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:port uuid="c75be99b-5a95-4330-acbb-12f982a1c492">
Oct 30 09:15:53 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 09:15:53 user nova-compute[75017]:         </nova:port>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:port uuid="8bf40fff-eeab-4a60-ae57-e3229ebac120">
Oct 30 09:15:53 user nova-compute[75017]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Oct 30 09:15:53 user nova-compute[75017]:         </nova:port>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:port uuid="288a1cda-73d5-4222-a7a9-5657efaa45da">
Oct 30 09:15:53 user nova-compute[75017]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Oct 30 09:15:53 user nova-compute[75017]:         </nova:port>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:port uuid="49e4404a-1322-473f-bb99-9ba80c17d01f">
Oct 30 09:15:53 user nova-compute[75017]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Oct 30 09:15:53 user nova-compute[75017]:         </nova:port>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:port uuid="e924d1fa-1e09-4b03-a940-0408f564be1e">
Oct 30 09:15:53 user nova-compute[75017]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Oct 30 09:15:53 user nova-compute[75017]:         </nova:port>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:port uuid="6009b5bc-376f-4b61-8e1c-b0bb4864c686">
Oct 30 09:15:53 user nova-compute[75017]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 30 09:15:53 user nova-compute[75017]:         </nova:port>
Oct 30 09:15:53 user nova-compute[75017]:         <nova:port uuid="e0f83c4e-90a4-46d9-852a-91a732e2fdde">
Oct 30 09:15:53 user nova-compute[75017]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 30 09:15:53 user nova-compute[75017]:         </nova:port>
Oct 30 09:15:53 user nova-compute[75017]:       </nova:ports>
Oct 30 09:15:53 user nova-compute[75017]:     </nova:instance>
Oct 30 09:15:53 user nova-compute[75017]:   </metadata>
Oct 30 09:15:53 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:15:53 user nova-compute[75017]:     <system>
Oct 30 09:15:53 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:15:53 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:15:53 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:15:53 user nova-compute[75017]:       <entry name="serial">e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9</entry>
Oct 30 09:15:53 user nova-compute[75017]:       <entry name="uuid">e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9</entry>
Oct 30 09:15:53 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:15:53 user nova-compute[75017]:     </system>
Oct 30 09:15:53 user nova-compute[75017]:   </sysinfo>
Oct 30 09:15:53 user nova-compute[75017]:   <os>
Oct 30 09:15:53 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:15:53 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:15:53 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:15:53 user nova-compute[75017]:   </os>
Oct 30 09:15:53 user nova-compute[75017]:   <features>
Oct 30 09:15:53 user nova-compute[75017]:     <acpi/>
Oct 30 09:15:53 user nova-compute[75017]:     <apic/>
Oct 30 09:15:53 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:15:53 user nova-compute[75017]:   </features>
Oct 30 09:15:53 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:15:53 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:15:53 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:15:53 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:15:53 user nova-compute[75017]:   </clock>
Oct 30 09:15:53 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:15:53 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:15:53 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:15:53 user nova-compute[75017]:   </cpu>
Oct 30 09:15:53 user nova-compute[75017]:   <devices>
Oct 30 09:15:53 user nova-compute[75017]:     <disk type="file" device="cdrom">
Oct 30 09:15:53 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 09:15:53 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9/disk.config"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="hda" bus="ide"/>
Oct 30 09:15:53 user nova-compute[75017]:     </disk>
Oct 30 09:15:53 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:15:53 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:53 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <serial>90ad41d5-afce-494c-b728-29ade5213a78</serial>
Oct 30 09:15:53 user nova-compute[75017]:     </disk>
Oct 30 09:15:53 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:15:53 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:53 user nova-compute[75017]:       <source dev="/dev/sdi"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <serial>393d50bc-a569-4ca3-9fc0-d9fe061b5d4b</serial>
Oct 30 09:15:53 user nova-compute[75017]:     </disk>
Oct 30 09:15:53 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:15:53 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:15:53 user nova-compute[75017]:       <source dev="/dev/sdj"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="vdc" bus="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <serial>d5f577a2-5b80-4c55-a271-a20fa82fc6c1</serial>
Oct 30 09:15:53 user nova-compute[75017]:     </disk>
Oct 30 09:15:53 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:15:53 user nova-compute[75017]:       <mac address="fa:16:3e:81:2d:08"/>
Oct 30 09:15:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="tapc75be99b-5a"/>
Oct 30 09:15:53 user nova-compute[75017]:     </interface>
Oct 30 09:15:53 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:15:53 user nova-compute[75017]:       <mac address="fa:16:3e:d8:2c:4d"/>
Oct 30 09:15:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="tap8bf40fff-ee"/>
Oct 30 09:15:53 user nova-compute[75017]:     </interface>
Oct 30 09:15:53 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:15:53 user nova-compute[75017]:       <mac address="fa:16:3e:9f:0a:8a"/>
Oct 30 09:15:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="tap288a1cda-73"/>
Oct 30 09:15:53 user nova-compute[75017]:     </interface>
Oct 30 09:15:53 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:15:53 user nova-compute[75017]:       <mac address="fa:16:3e:a5:5b:ce"/>
Oct 30 09:15:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="tap49e4404a-13"/>
Oct 30 09:15:53 user nova-compute[75017]:     </interface>
Oct 30 09:15:53 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:15:53 user nova-compute[75017]:       <mac address="fa:16:3e:fd:be:36"/>
Oct 30 09:15:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="tape924d1fa-1e"/>
Oct 30 09:15:53 user nova-compute[75017]:     </interface>
Oct 30 09:15:53 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:15:53 user nova-compute[75017]:       <mac address="fa:16:3e:52:84:19"/>
Oct 30 09:15:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="tap6009b5bc-37"/>
Oct 30 09:15:53 user nova-compute[75017]:     </interface>
Oct 30 09:15:53 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:15:53 user nova-compute[75017]:       <mac address="fa:16:3e:0d:84:ac"/>
Oct 30 09:15:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:15:53 user nova-compute[75017]:       <target dev="tape0f83c4e-90"/>
Oct 30 09:15:53 user nova-compute[75017]:     </interface>
Oct 30 09:15:53 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:15:53 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9/console.log" append="off"/>
Oct 30 09:15:53 user nova-compute[75017]:     </serial>
Oct 30 09:15:53 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:15:53 user nova-compute[75017]:     <video>
Oct 30 09:15:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:15:53 user nova-compute[75017]:     </video>
Oct 30 09:15:53 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:15:53 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:15:53 user nova-compute[75017]:     </rng>
Oct 30 09:15:53 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:15:53 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:15:53 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:15:53 user nova-compute[75017]:     </memballoon>
Oct 30 09:15:53 user nova-compute[75017]:   </devices>
Oct 30 09:15:53 user nova-compute[75017]: </domain>
Oct 30 09:15:53 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:08,bridge_name='br-int',has_traffic_filtering=True,id=c75be99b-5a95-4330-acbb-12f982a1c492,network=Network(3ead5234-8276-41ed-b788-f2ebf3724feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75be99b-5a') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:08,bridge_name='br-int',has_traffic_filtering=True,id=c75be99b-5a95-4330-acbb-12f982a1c492,network=Network(3ead5234-8276-41ed-b788-f2ebf3724feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75be99b-5a') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8f460a2-cdca-5740-a285-15c98d5e61ec', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc75be99b-5a, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc75be99b-5a, col_values=(('qos', UUID('6559f94c-f881-49cc-9343-777b40fac7ae')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc75be99b-5a, col_values=(('external_ids', {'iface-id': 'c75be99b-5a95-4330-acbb-12f982a1c492', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:2d:08', 'vm-uuid': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: INFO os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:08,bridge_name='br-int',has_traffic_filtering=True,id=c75be99b-5a95-4330-acbb-12f982a1c492,network=Network(3ead5234-8276-41ed-b788-f2ebf3724feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75be99b-5a')
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2c:4d,bridge_name='br-int',has_traffic_filtering=True,id=8bf40fff-eeab-4a60-ae57-e3229ebac120,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bf40fff-ee') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2c:4d,bridge_name='br-int',has_traffic_filtering=True,id=8bf40fff-eeab-4a60-ae57-e3229ebac120,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bf40fff-ee') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ef7ef41-8471-5d25-8057-14e5d6d356f2', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bf40fff-ee, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bf40fff-ee, col_values=(('qos', UUID('fe44e45d-f86a-47df-aeb9-6c675acccb6f')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bf40fff-ee, col_values=(('external_ids', {'iface-id': '8bf40fff-eeab-4a60-ae57-e3229ebac120', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:2c:4d', 'vm-uuid': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: INFO os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2c:4d,bridge_name='br-int',has_traffic_filtering=True,id=8bf40fff-eeab-4a60-ae57-e3229ebac120,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bf40fff-ee')
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:8a,bridge_name='br-int',has_traffic_filtering=True,id=288a1cda-73d5-4222-a7a9-5657efaa45da,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap288a1cda-73') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:8a,bridge_name='br-int',has_traffic_filtering=True,id=288a1cda-73d5-4222-a7a9-5657efaa45da,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap288a1cda-73') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b88e350-5e5d-52c3-a925-d58d0ad637cd', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap288a1cda-73, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap288a1cda-73, col_values=(('qos', UUID('527a49e9-0da4-4bad-b90d-d47fed29b60e')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap288a1cda-73, col_values=(('external_ids', {'iface-id': '288a1cda-73d5-4222-a7a9-5657efaa45da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:0a:8a', 'vm-uuid': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: INFO os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:8a,bridge_name='br-int',has_traffic_filtering=True,id=288a1cda-73d5-4222-a7a9-5657efaa45da,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap288a1cda-73')
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:5b:ce,bridge_name='br-int',has_traffic_filtering=True,id=49e4404a-1322-473f-bb99-9ba80c17d01f,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e4404a-13') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:5b:ce,bridge_name='br-int',has_traffic_filtering=True,id=49e4404a-1322-473f-bb99-9ba80c17d01f,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e4404a-13') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c075088-fedd-5a96-a915-a95fb0be4fd4', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49e4404a-13, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49e4404a-13, col_values=(('qos', UUID('d8305d63-d226-4381-ad68-352a69078e10')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49e4404a-13, col_values=(('external_ids', {'iface-id': '49e4404a-1322-473f-bb99-9ba80c17d01f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:5b:ce', 'vm-uuid': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: INFO os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:5b:ce,bridge_name='br-int',has_traffic_filtering=True,id=49e4404a-1322-473f-bb99-9ba80c17d01f,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e4404a-13')
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:be:36,bridge_name='br-int',has_traffic_filtering=True,id=e924d1fa-1e09-4b03-a940-0408f564be1e,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape924d1fa-1e') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:be:36,bridge_name='br-int',has_traffic_filtering=True,id=e924d1fa-1e09-4b03-a940-0408f564be1e,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape924d1fa-1e') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d9f0ed1-b85b-5aa0-8a9c-8422b7bd9461', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape924d1fa-1e, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape924d1fa-1e, col_values=(('qos', UUID('59d35d98-2e14-4d10-b2d0-d84f62eb9238')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape924d1fa-1e, col_values=(('external_ids', {'iface-id': 'e924d1fa-1e09-4b03-a940-0408f564be1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:be:36', 'vm-uuid': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: INFO os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:be:36,bridge_name='br-int',has_traffic_filtering=True,id=e924d1fa-1e09-4b03-a940-0408f564be1e,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape924d1fa-1e')
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:19,bridge_name='br-int',has_traffic_filtering=True,id=6009b5bc-376f-4b61-8e1c-b0bb4864c686,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009b5bc-37') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:19,bridge_name='br-int',has_traffic_filtering=True,id=6009b5bc-376f-4b61-8e1c-b0bb4864c686,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009b5bc-37') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd53c7bd1-e2f2-5439-815e-10f3248a5ff7', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6009b5bc-37, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6009b5bc-37, col_values=(('qos', UUID('5d19b195-6b39-42a7-a593-b04ee16a700c')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6009b5bc-37, col_values=(('external_ids', {'iface-id': '6009b5bc-376f-4b61-8e1c-b0bb4864c686', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:84:19', 'vm-uuid': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: INFO os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:19,bridge_name='br-int',has_traffic_filtering=True,id=6009b5bc-376f-4b61-8e1c-b0bb4864c686,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009b5bc-37')
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0f83c4e-90a4-46d9-852a-91a732e2fdde,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f83c4e-90') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0f83c4e-90a4-46d9-852a-91a732e2fdde,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f83c4e-90') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91db8134-0ae8-5eb1-a76a-0252224e9c03', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0f83c4e-90, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0f83c4e-90, col_values=(('qos', UUID('ce9905f9-a482-43db-903a-75a5392c2c53')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0f83c4e-90, col_values=(('external_ids', {'iface-id': 'e0f83c4e-90a4-46d9-852a-91a732e2fdde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:84:ac', 'vm-uuid': 'e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:54 user nova-compute[75017]: INFO os_vif [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0f83c4e-90a4-46d9-852a-91a732e2fdde,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f83c4e-90')
Oct 30 09:15:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] No BDM found with device name hda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] No VIF found with MAC fa:16:3e:81:2d:08, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] No VIF found with MAC fa:16:3e:fd:be:36, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:15:54 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Using config drive
Oct 30 09:15:54 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Creating config drive at /opt/stack/data/nova/instances/e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9/disk.config
Oct 30 09:15:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp94lc86h7 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp94lc86h7" returned: 0 in 0.057s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:15:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-ef1a9946-5683-46a3-ae72-5ef14a3a08cc req-91059591-7751-4d2a-8434-2f9b77632b74 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ef1a9946-5683-46a3-ae72-5ef14a3a08cc req-91059591-7751-4d2a-8434-2f9b77632b74 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ef1a9946-5683-46a3-ae72-5ef14a3a08cc req-91059591-7751-4d2a-8434-2f9b77632b74 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ef1a9946-5683-46a3-ae72-5ef14a3a08cc req-91059591-7751-4d2a-8434-2f9b77632b74 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-ef1a9946-5683-46a3-ae72-5ef14a3a08cc req-91059591-7751-4d2a-8434-2f9b77632b74 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:56 user nova-compute[75017]: WARNING nova.compute.manager [req-ef1a9946-5683-46a3-ae72-5ef14a3a08cc req-91059591-7751-4d2a-8434-2f9b77632b74 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-c75be99b-5a95-4330-acbb-12f982a1c492 for instance with vm_state building and task_state spawning.
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-eebd4470-1228-4689-975e-63701ac322e1 req-3fb3ca04-2104-4649-a680-1de7740563cd service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eebd4470-1228-4689-975e-63701ac322e1 req-3fb3ca04-2104-4649-a680-1de7740563cd service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eebd4470-1228-4689-975e-63701ac322e1 req-3fb3ca04-2104-4649-a680-1de7740563cd service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eebd4470-1228-4689-975e-63701ac322e1 req-3fb3ca04-2104-4649-a680-1de7740563cd service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-eebd4470-1228-4689-975e-63701ac322e1 req-3fb3ca04-2104-4649-a680-1de7740563cd service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:56 user nova-compute[75017]: WARNING nova.compute.manager [req-eebd4470-1228-4689-975e-63701ac322e1 req-3fb3ca04-2104-4649-a680-1de7740563cd service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 for instance with vm_state building and task_state spawning.
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3674dc3-6c5f-484f-b2bb-ea2714028cbf req-89c0bf21-9a93-417e-a5a2-ad3c482aec2f service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3674dc3-6c5f-484f-b2bb-ea2714028cbf req-89c0bf21-9a93-417e-a5a2-ad3c482aec2f service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3674dc3-6c5f-484f-b2bb-ea2714028cbf req-89c0bf21-9a93-417e-a5a2-ad3c482aec2f service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3674dc3-6c5f-484f-b2bb-ea2714028cbf req-89c0bf21-9a93-417e-a5a2-ad3c482aec2f service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3674dc3-6c5f-484f-b2bb-ea2714028cbf req-89c0bf21-9a93-417e-a5a2-ad3c482aec2f service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:56 user nova-compute[75017]: WARNING nova.compute.manager [req-c3674dc3-6c5f-484f-b2bb-ea2714028cbf req-89c0bf21-9a93-417e-a5a2-ad3c482aec2f service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-288a1cda-73d5-4222-a7a9-5657efaa45da for instance with vm_state building and task_state spawning.
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:58 user nova-compute[75017]: WARNING nova.compute.manager [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-c75be99b-5a95-4330-acbb-12f982a1c492 for instance with vm_state building and task_state spawning.
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:58 user nova-compute[75017]: WARNING nova.compute.manager [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-49e4404a-1322-473f-bb99-9ba80c17d01f for instance with vm_state building and task_state spawning.
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:58 user nova-compute[75017]: WARNING nova.compute.manager [req-96fd33f3-6bbd-49f2-880f-04e7db8e7344 req-1760a535-4c0d-434d-b49b-9cc77ee3cd0c service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-49e4404a-1322-473f-bb99-9ba80c17d01f for instance with vm_state building and task_state spawning.
Oct 30 09:15:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:58 user nova-compute[75017]: WARNING nova.compute.manager [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 for instance with vm_state building and task_state spawning.
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:58 user nova-compute[75017]: WARNING nova.compute.manager [req-620d31ea-9deb-42a5-a1be-b9e4c50f2e58 req-4ec0594e-15cf-43c7-9140-944bad00e506 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 for instance with vm_state building and task_state spawning.
Oct 30 09:15:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:59 user nova-compute[75017]: WARNING nova.compute.manager [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-288a1cda-73d5-4222-a7a9-5657efaa45da for instance with vm_state building and task_state spawning.
Oct 30 09:15:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:59 user nova-compute[75017]: WARNING nova.compute.manager [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-e924d1fa-1e09-4b03-a940-0408f564be1e for instance with vm_state building and task_state spawning.
Oct 30 09:15:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:15:59 user nova-compute[75017]: WARNING nova.compute.manager [req-524d50f4-7a91-471b-932b-21f3910eb604 req-463d8586-82a8-4679-9d13-60412b57cf61 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-e924d1fa-1e09-4b03-a940-0408f564be1e for instance with vm_state building and task_state spawning.
Oct 30 09:15:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:15:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:16:00 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance spawned successfully.
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:00 user nova-compute[75017]: WARNING nova.compute.manager [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 for instance with vm_state building and task_state spawning.
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:00 user nova-compute[75017]: WARNING nova.compute.manager [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde for instance with vm_state building and task_state spawning.
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:00 user nova-compute[75017]: WARNING nova.compute.manager [req-c22382ef-f9bc-4178-8df9-99151ae124a6 req-2ce0674d-4940-4aa2-8704-7ca1fd735c7d service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde for instance with vm_state building and task_state spawning.
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:00 user nova-compute[75017]: INFO nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Took 11.64 seconds to spawn the instance on the hypervisor.
Oct 30 09:16:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:16:00 user nova-compute[75017]: INFO nova.compute.manager [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Took 111.69 seconds to build instance.
Oct 30 09:16:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c1fa11d9-86ff-4d85-8e72-76976afb651f tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 111.862s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:06 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 is timed out.
Oct 30 09:16:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Successfully detached device vdb from instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 from the live domain config.
Oct 30 09:16:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPHbKkfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:16:06 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee570f-2cca-4672-bd60-597c0eed4963]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:16:06 user nova-compute[75017]: No targets found.
Oct 30 09:16:06 user nova-compute[75017]: iSNS:
Oct 30 09:16:06 user nova-compute[75017]: No targets found.
Oct 30 09:16:06 user nova-compute[75017]: STATIC:
Oct 30 09:16:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c
Oct 30 09:16:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b
Oct 30 09:16:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f
Oct 30 09:16:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9
Oct 30 09:16:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671
Oct 30 09:16:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78
Oct 30 09:16:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:16:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:16:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1
Oct 30 09:16:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:06 user nova-compute[75017]: FIRMWARE:
Oct 30 09:16:06 user nova-compute[75017]: No targets found.
Oct 30 09:16:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:16:06 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:16:06 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b163323-ae2b-4c3d-978c-da2b8ddece1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dab671-96a0-4ead-abdd-b72d57a45083]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:16:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf07e3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9090367b-c0db-49ef-ae49-0908280d10b8]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf02887-de69-4afd-ab8a-eadd11d16aba]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[644ea3d5-5498-4e00-b0b4-e83846dfce02]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b61a4f-9d36-4b92-980f-a66050601015]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6c3a3e-9c3e-4896-bde8-b37c0fa1d945]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cc9ea6-911d-4899-b299-ffb7d2f84b98]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f, portal: 172.16.0.220,3260]
Oct 30 09:16:06 user nova-compute[75017]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f, portal: 172.16.0.220,3260] successful.
Oct 30 09:16:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b080cd-4ffc-48c2-bd79-3dda74e60d4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d436552-20c5-4ab0-ac87-96d0e4d3444d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] <== disconnect_volume: return (441ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:16:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:16:07 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 963c57ec-14d7-43c1-a8dc-7a062446a559 is timed out.
Oct 30 09:16:07 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Successfully detached device sdc from instance 963c57ec-14d7-43c1-a8dc-7a062446a559 from the live domain config.
Oct 30 09:16:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpRgncqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:16:07 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2539a818-9939-428a-9027-66dc16408f3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:16:07 user nova-compute[75017]: No targets found.
Oct 30 09:16:07 user nova-compute[75017]: iSNS:
Oct 30 09:16:07 user nova-compute[75017]: No targets found.
Oct 30 09:16:07 user nova-compute[75017]: STATIC:
Oct 30 09:16:07 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c
Oct 30 09:16:07 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:07 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:07 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b
Oct 30 09:16:07 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:07 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:07 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9
Oct 30 09:16:07 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:07 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:07 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671
Oct 30 09:16:07 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:07 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:07 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78
Oct 30 09:16:07 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:07 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:07 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:16:07 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:07 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:07 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:16:07 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:07 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:07 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1
Oct 30 09:16:07 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:07 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:07 user nova-compute[75017]: FIRMWARE:
Oct 30 09:16:07 user nova-compute[75017]: No targets found.
Oct 30 09:16:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:16:07 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:16:07 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05c8366-b2af-45a6-ac52-0c7d695174b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c8d1f0-0f61-47c3-b99a-82f2a2376ca5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:16:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf04e05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c'): ({'sde'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Removing single pathed devices sde {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b911426b-1497-4d9c-8edb-5ce039d24913]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3e8a59-f8c5-4a9a-a298-c4733e0c5315]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Flushing IO for device /dev/sde {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f942c6-8982-4ca9-a373-918f50994f9a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.094s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdd1ed4-fc9f-4349-b0ac-09cd61a07f47]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffd0c08-9672-4730-a073-f3e4a5697fd7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efba970-d1c6-476a-8c9d-29b17d8c3fe3]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c, portal: 172.16.0.220,3260]
Oct 30 09:16:07 user nova-compute[75017]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c, portal: 172.16.0.220,3260] successful.
Oct 30 09:16:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baad9d2-42f6-46c9-a5f4-bc8bee3a882c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9841f06-6e33-4409-a8e6-02772eca803b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.588s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] <== disconnect_volume: return (589ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:16:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG nova.objects.instance [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lazy-loading 'flavor' on Instance uuid 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-38c3cb7e-3e26-4867-9028-b0b915a80934 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.037s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:08 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 32e25927-79c3-490f-b53a-03d4a6299e42 is timed out.
Oct 30 09:16:08 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Successfully detached device vdb from instance 32e25927-79c3-490f-b53a-03d4a6299e42 from the live domain config.
Oct 30 09:16:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXoPhrCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:16:08 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f1dbd7-0e02-44e0-a372-6e749518244b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:16:08 user nova-compute[75017]: No targets found.
Oct 30 09:16:08 user nova-compute[75017]: iSNS:
Oct 30 09:16:08 user nova-compute[75017]: No targets found.
Oct 30 09:16:08 user nova-compute[75017]: STATIC:
Oct 30 09:16:08 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b
Oct 30 09:16:08 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:08 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:08 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9
Oct 30 09:16:08 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:08 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:08 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671
Oct 30 09:16:08 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:08 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:08 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78
Oct 30 09:16:08 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:08 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:08 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:16:08 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:08 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:08 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:16:08 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:08 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:08 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1
Oct 30 09:16:08 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:08 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:08 user nova-compute[75017]: FIRMWARE:
Oct 30 09:16:08 user nova-compute[75017]: No targets found.
Oct 30 09:16:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:16:08 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:16:08 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccc868e-cf4c-49ad-b8b6-4782bf60015f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a740750a-225c-43c7-8394-90409cff6bd7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:16:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d1cfe3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9'): ({'sdg'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Removing single pathed devices sdg {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e46940c-0b36-49eb-8fd7-3848d3c9af82]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c4ed1-9946-4c65-907d-2942b4558fe3]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Flushing IO for device /dev/sdg {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b2f888-f83b-42ef-84aa-2354f5c055eb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[938c8ae5-c88c-4cde-a2f7-7bcd46f6aeb6]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] SCSI volumes sdg have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb3becb-7841-4d00-a6b8-6cd0049f6328]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ddff90-c53a-4488-acaf-af3c696ad1eb]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9, portal: 172.16.0.220,3260]
Oct 30 09:16:08 user nova-compute[75017]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9, portal: 172.16.0.220,3260] successful.
Oct 30 09:16:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4cd50a-e44f-4d47-b42b-f00a01cbe7c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f716a295-9212-4c64-abff-4e3454002dc5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.485s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] <== disconnect_volume: return (488ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:16:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lazy-loading 'flavor' on Instance uuid 963c57ec-14d7-43c1-a8dc-7a062446a559 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d9745741-d90b-470c-839e-f1f4f775377a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.293s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "963c57ec-14d7-43c1-a8dc-7a062446a559" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "963c57ec-14d7-43c1-a8dc-7a062446a559-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:09 user nova-compute[75017]: INFO nova.compute.manager [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Terminating instance
Oct 30 09:16:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:16:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG nova.objects.instance [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lazy-loading 'flavor' on Instance uuid 32e25927-79c3-490f-b53a-03d4a6299e42 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-141f4ee8-c9ac-457b-ad50-af10802e3031 tempest-VolumesAssistedSnapshotsTest-695134605 tempest-VolumesAssistedSnapshotsTest-695134605-project-admin] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.558s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:10 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Instance destroyed successfully.
Oct 30 09:16:10 user nova-compute[75017]: DEBUG nova.objects.instance [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lazy-loading 'resources' on Instance uuid 963c57ec-14d7-43c1-a8dc-7a062446a559 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1030192591',display_name='tempest-AttachSCSIVolumeTestJSON-server-1030192591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1030192591',id=4,image_ref='01488e71-0386-4514-922a-b9f486c71d44',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxoppndYjpfZV76+RIt5RD9qLCnES/AVw3xjdHhn0qIw920w5D6+PpqpIQqaT7DnTSpOOLREvRYWbX1+7qMhhyVC0+XQjMhpAyUdSiiSrFnRjNqt2L1DH3+yKGB+yCqKQ==',key_name='tempest-keypair-1571516340',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8afbb27caf18452f85392a059ce8e2ed',ramdisk_id='',reservation_id='r-0o7hvb7b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01488e71-0386-4514-922a-b9f486c71d44',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-525777381',owner_user_name='tempest-AttachSCSIVolumeTestJSON-525777381-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b6b956772404d03a272335ca4d22284',uuid=963c57ec-14d7-43c1-a8dc-7a062446a559,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Converting VIF {"id": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "address": "fa:16:3e:28:89:14", "network": {"id": "6148b73f-e56c-4e40-aeb1-2973d55af261", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-147701758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbb27caf18452f85392a059ce8e2ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdc6f86-f4", "ovs_interfaceid": "5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:89:14,bridge_name='br-int',has_traffic_filtering=True,id=5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a,network=Network(6148b73f-e56c-4e40-aeb1-2973d55af261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdc6f86-f4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG os_vif [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:89:14,bridge_name='br-int',has_traffic_filtering=True,id=5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a,network=Network(6148b73f-e56c-4e40-aeb1-2973d55af261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdc6f86-f4') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cdc6f86-f4, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cd143f5-fc04-4210-931c-af369c6654f1) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:10 user nova-compute[75017]: INFO os_vif [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:89:14,bridge_name='br-int',has_traffic_filtering=True,id=5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a,network=Network(6148b73f-e56c-4e40-aeb1-2973d55af261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdc6f86-f4')
Oct 30 09:16:10 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Deleting instance files /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559_del
Oct 30 09:16:10 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Deletion of /opt/stack/data/nova/instances/963c57ec-14d7-43c1-a8dc-7a062446a559_del complete
Oct 30 09:16:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: INFO nova.compute.manager [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:16:11 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17969235-fc8b-4b25-995b-fdce8b496974 is timed out.
Oct 30 09:16:11 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Successfully detached device vdb from instance 17969235-fc8b-4b25-995b-fdce8b496974 from the live domain config.
Oct 30 09:16:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEHvdDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:16:11 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef1c10f-58f5-474c-a1f5-34cad3046afe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:16:11 user nova-compute[75017]: No targets found.
Oct 30 09:16:11 user nova-compute[75017]: iSNS:
Oct 30 09:16:11 user nova-compute[75017]: No targets found.
Oct 30 09:16:11 user nova-compute[75017]: STATIC:
Oct 30 09:16:11 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b
Oct 30 09:16:11 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:11 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:11 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671
Oct 30 09:16:11 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:11 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:11 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78
Oct 30 09:16:11 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:11 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:11 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:16:11 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:11 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:11 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:16:11 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:11 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:11 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1
Oct 30 09:16:11 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:16:11 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:16:11 user nova-compute[75017]: FIRMWARE:
Oct 30 09:16:11 user nova-compute[75017]: No targets found.
Oct 30 09:16:11 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:16:11 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:16:11 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3453c9-8ead-408b-8b13-79be3f913181]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24acded-3d13-4a26-9920-2d759904bc00]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:16:11 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:16:11 user nova-compute[75017]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 (non-flash)
Oct 30 09:16:11 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccebaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671'): ({'sdh'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Removing single pathed devices sdh {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91d5d84-b121-49eb-98b2-22fa5c6e6472]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1145e2-d440-43cc-9607-bd09caa118cf]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Flushing IO for device /dev/sdh {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[282695aa-0bc7-4f1f-b054-cf7bf27c7a22]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f352d6e5-f229-418a-87d1-84b305ca0f29]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] SCSI volumes sdh have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bcc062-a988-4b42-9ff1-69125affd4e0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb1702c-b79f-46db-8a4a-fff4d6e03032]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671, portal: 172.16.0.220,3260]
Oct 30 09:16:11 user nova-compute[75017]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671, portal: 172.16.0.220,3260] successful.
Oct 30 09:16:11 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c3c341-bd46-4334-8dd5-732616fca671 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df4513-95de-4964-adce-9a8b7c0bdfcb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.507s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] <== disconnect_volume: return (508ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "c6aae433-005c-4b50-9006-d71bca0f8368" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:16:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:16:12 user nova-compute[75017]: INFO nova.compute.claims [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Claim successful on node user
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:16:12 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Took 1.47 seconds to deallocate network for instance.
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-58f33a31-21dc-4070-82ad-d52e72ca2bbf req-c5f19a76-fb59-454f-989a-ca1148589ac0 service nova] [instance: 963c57ec-14d7-43c1-a8dc-7a062446a559] Received event network-vif-deleted-5cdc6f86-f4ed-44d5-a7b8-468ed88c7d8a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.898s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.890s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:16:13 user nova-compute[75017]: INFO nova.compute.claims [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Claim successful on node user
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.network.neutron [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lazy-loading 'flavor' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:13 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.policy [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7b340dac0544150bc642f7ecfb07157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1e0e03de5c497a94c9c6267e623573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f26f95ae-6b1c-496b-b1f8-6178730b7685 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.669s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:16:13 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Creating image(s)
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:13 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid '963c57ec-14d7-43c1-a8dc-7a062446a559' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid '963c57ec-14d7-43c1-a8dc-7a062446a559' (instance-00000004)
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "interface-17969235-fc8b-4b25-995b-fdce8b496974-a09feea2-ad99-45ce-a6f3-4286f4f7e063" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "interface-17969235-fc8b-4b25-995b-fdce8b496974-a09feea2-ad99-45ce-a6f3-4286f4f7e063" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lazy-loading 'flavor' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-57449668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-57449668',id=7,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISm4h9XE1KNjZ2BtaUqmuhfL1YRvfcyLbox2ZePi/EII8ogZ6S4AfZo+/2Z52igxxz2fW/Rx2pXwsmh/8mnYbXpfRpgYHTdJLGwxN4G2z5fHYm02Wr1qLrrUa0GrO3NaQ==',key_name='tempest-keypair-1815186852',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cbfa2cb0b7e442eb6a91f94df21dbe0',ramdisk_id='',reservation_id='r-zhoyj2oj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2138896194',owner_user_name='tempest-TaggedAttachmentsTest-2138896194-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72543d1c58b7444aa36e252b59f33625',uuid=17969235-fc8b-4b25-995b-fdce8b496974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converting VIF {"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk 1073741824" returned: 0 in 0.069s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface> {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface> {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Attempting to detach device tapa09feea2-ad from instance 17969235-fc8b-4b25-995b-fdce8b496974 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:16:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] detach device xml: <interface type="ethernet">
Oct 30 09:16:13 user nova-compute[75017]:   <mac address="fa:16:3e:8c:b2:26"/>
Oct 30 09:16:13 user nova-compute[75017]:   <model type="virtio"/>
Oct 30 09:16:13 user nova-compute[75017]:   <mtu size="1442"/>
Oct 30 09:16:13 user nova-compute[75017]:   <target dev="tapa09feea2-ad"/>
Oct 30 09:16:13 user nova-compute[75017]: </interface>
Oct 30 09:16:13 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.network.neutron [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Successfully created port: bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface> {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.617s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 30 09:16:14 user nova-compute[75017]:   <name>instance-00000007</name>
Oct 30 09:16:14 user nova-compute[75017]:   <uuid>17969235-fc8b-4b25-995b-fdce8b496974</uuid>
Oct 30 09:16:14 user nova-compute[75017]:   <metadata>
Oct 30 09:16:14 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:14 user nova-compute[75017]:   <nova:package version="0.0.0"/>
Oct 30 09:16:14 user nova-compute[75017]:   <nova:name>tempest-device-tagging-server-57449668</nova:name>
Oct 30 09:16:14 user nova-compute[75017]:   <nova:creationTime>2023-10-30 09:14:47</nova:creationTime>
Oct 30 09:16:14 user nova-compute[75017]:   <nova:flavor name="m1.tiny">
Oct 30 09:16:14 user nova-compute[75017]:     <nova:memory>512</nova:memory>
Oct 30 09:16:14 user nova-compute[75017]:     <nova:disk>1</nova:disk>
Oct 30 09:16:14 user nova-compute[75017]:     <nova:swap>0</nova:swap>
Oct 30 09:16:14 user nova-compute[75017]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:14 user nova-compute[75017]:     <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:14 user nova-compute[75017]:   </nova:flavor>
Oct 30 09:16:14 user nova-compute[75017]:   <nova:owner>
Oct 30 09:16:14 user nova-compute[75017]:     <nova:user uuid="72543d1c58b7444aa36e252b59f33625">tempest-TaggedAttachmentsTest-2138896194-project-member</nova:user>
Oct 30 09:16:14 user nova-compute[75017]:     <nova:project uuid="2cbfa2cb0b7e442eb6a91f94df21dbe0">tempest-TaggedAttachmentsTest-2138896194</nova:project>
Oct 30 09:16:14 user nova-compute[75017]:   </nova:owner>
Oct 30 09:16:14 user nova-compute[75017]:   <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:14 user nova-compute[75017]:   <nova:ports>
Oct 30 09:16:14 user nova-compute[75017]:     <nova:port uuid="840e6749-42d0-4bb0-9787-a348ca450fe7">
Oct 30 09:16:14 user nova-compute[75017]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:16:14 user nova-compute[75017]:     </nova:port>
Oct 30 09:16:14 user nova-compute[75017]:     <nova:port uuid="a09feea2-ad99-45ce-a6f3-4286f4f7e063">
Oct 30 09:16:14 user nova-compute[75017]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Oct 30 09:16:14 user nova-compute[75017]:     </nova:port>
Oct 30 09:16:14 user nova-compute[75017]:   </nova:ports>
Oct 30 09:16:14 user nova-compute[75017]: </nova:instance>
Oct 30 09:16:14 user nova-compute[75017]:   </metadata>
Oct 30 09:16:14 user nova-compute[75017]:   <memory unit='KiB'>524288</memory>
Oct 30 09:16:14 user nova-compute[75017]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 09:16:14 user nova-compute[75017]:   <vcpu placement='static'>1</vcpu>
Oct 30 09:16:14 user nova-compute[75017]:   <resource>
Oct 30 09:16:14 user nova-compute[75017]:     <partition>/machine</partition>
Oct 30 09:16:14 user nova-compute[75017]:   </resource>
Oct 30 09:16:14 user nova-compute[75017]:   <sysinfo type='smbios'>
Oct 30 09:16:14 user nova-compute[75017]:     <system>
Oct 30 09:16:14 user nova-compute[75017]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 09:16:14 user nova-compute[75017]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 09:16:14 user nova-compute[75017]:       <entry name='version'>0.0.0</entry>
Oct 30 09:16:14 user nova-compute[75017]:       <entry name='serial'>17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:16:14 user nova-compute[75017]:       <entry name='uuid'>17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:16:14 user nova-compute[75017]:       <entry name='family'>Virtual Machine</entry>
Oct 30 09:16:14 user nova-compute[75017]:     </system>
Oct 30 09:16:14 user nova-compute[75017]:   </sysinfo>
Oct 30 09:16:14 user nova-compute[75017]:   <os>
Oct 30 09:16:14 user nova-compute[75017]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 09:16:14 user nova-compute[75017]:     <boot dev='hd'/>
Oct 30 09:16:14 user nova-compute[75017]:     <smbios mode='sysinfo'/>
Oct 30 09:16:14 user nova-compute[75017]:   </os>
Oct 30 09:16:14 user nova-compute[75017]:   <features>
Oct 30 09:16:14 user nova-compute[75017]:     <acpi/>
Oct 30 09:16:14 user nova-compute[75017]:     <apic/>
Oct 30 09:16:14 user nova-compute[75017]:     <vmcoreinfo state='on'/>
Oct 30 09:16:14 user nova-compute[75017]:   </features>
Oct 30 09:16:14 user nova-compute[75017]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 09:16:14 user nova-compute[75017]:     <model fallback='forbid'>Nehalem</model>
Oct 30 09:16:14 user nova-compute[75017]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 09:16:14 user nova-compute[75017]:     <feature policy='require' name='vme'/>
Oct 30 09:16:14 user nova-compute[75017]:     <feature policy='require' name='x2apic'/>
Oct 30 09:16:14 user nova-compute[75017]:     <feature policy='require' name='hypervisor'/>
Oct 30 09:16:14 user nova-compute[75017]:   </cpu>
Oct 30 09:16:14 user nova-compute[75017]:   <clock offset='utc'>
Oct 30 09:16:14 user nova-compute[75017]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 09:16:14 user nova-compute[75017]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 09:16:14 user nova-compute[75017]:     <timer name='hpet' present='no'/>
Oct 30 09:16:14 user nova-compute[75017]:   </clock>
Oct 30 09:16:14 user nova-compute[75017]:   <on_poweroff>destroy</on_poweroff>
Oct 30 09:16:14 user nova-compute[75017]:   <on_reboot>restart</on_reboot>
Oct 30 09:16:14 user nova-compute[75017]:   <on_crash>destroy</on_crash>
Oct 30 09:16:14 user nova-compute[75017]:   <devices>
Oct 30 09:16:14 user nova-compute[75017]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 09:16:14 user nova-compute[75017]:     <disk type='file' device='disk'>
Oct 30 09:16:14 user nova-compute[75017]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 09:16:14 user nova-compute[75017]:       <source file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk' index='2'/>
Oct 30 09:16:14 user nova-compute[75017]:       <backingStore type='file' index='3'>
Oct 30 09:16:14 user nova-compute[75017]:         <format type='raw'/>
Oct 30 09:16:14 user nova-compute[75017]:         <source file='/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1'/>
Oct 30 09:16:14 user nova-compute[75017]:         <backingStore/>
Oct 30 09:16:14 user nova-compute[75017]:       </backingStore>
Oct 30 09:16:14 user nova-compute[75017]:       <target dev='vda' bus='virtio'/>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='virtio-disk0'/>
Oct 30 09:16:14 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </disk>
Oct 30 09:16:14 user nova-compute[75017]:     <disk type='file' device='cdrom'>
Oct 30 09:16:14 user nova-compute[75017]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 09:16:14 user nova-compute[75017]:       <source file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.config' index='1'/>
Oct 30 09:16:14 user nova-compute[75017]:       <backingStore/>
Oct 30 09:16:14 user nova-compute[75017]:       <target dev='hda' bus='ide'/>
Oct 30 09:16:14 user nova-compute[75017]:       <readonly/>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='ide0-0-0'/>
Oct 30 09:16:14 user nova-compute[75017]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </disk>
Oct 30 09:16:14 user nova-compute[75017]:     <controller type='usb' index='0' model='none'>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='usb'/>
Oct 30 09:16:14 user nova-compute[75017]:     </controller>
Oct 30 09:16:14 user nova-compute[75017]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='pci.0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </controller>
Oct 30 09:16:14 user nova-compute[75017]:     <controller type='ide' index='0'>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='ide'/>
Oct 30 09:16:14 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 09:16:14 user nova-compute[75017]:     </controller>
Oct 30 09:16:14 user nova-compute[75017]:     <interface type='ethernet'>
Oct 30 09:16:14 user nova-compute[75017]:       <mac address='fa:16:3e:3a:5d:f7'/>
Oct 30 09:16:14 user nova-compute[75017]:       <target dev='tap840e6749-42'/>
Oct 30 09:16:14 user nova-compute[75017]:       <model type='virtio'/>
Oct 30 09:16:14 user nova-compute[75017]:       <mtu size='1442'/>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='net0'/>
Oct 30 09:16:14 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </interface>
Oct 30 09:16:14 user nova-compute[75017]:     <interface type='ethernet'>
Oct 30 09:16:14 user nova-compute[75017]:       <mac address='fa:16:3e:8c:b2:26'/>
Oct 30 09:16:14 user nova-compute[75017]:       <target dev='tapa09feea2-ad'/>
Oct 30 09:16:14 user nova-compute[75017]:       <model type='virtio'/>
Oct 30 09:16:14 user nova-compute[75017]:       <mtu size='1442'/>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='net1'/>
Oct 30 09:16:14 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </interface>
Oct 30 09:16:14 user nova-compute[75017]:     <serial type='pty'>
Oct 30 09:16:14 user nova-compute[75017]:       <source path='/dev/pts/5'/>
Oct 30 09:16:14 user nova-compute[75017]:       <log file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log' append='off'/>
Oct 30 09:16:14 user nova-compute[75017]:       <target type='isa-serial' port='0'>
Oct 30 09:16:14 user nova-compute[75017]:         <model name='isa-serial'/>
Oct 30 09:16:14 user nova-compute[75017]:       </target>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='serial0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </serial>
Oct 30 09:16:14 user nova-compute[75017]:     <console type='pty' tty='/dev/pts/5'>
Oct 30 09:16:14 user nova-compute[75017]:       <source path='/dev/pts/5'/>
Oct 30 09:16:14 user nova-compute[75017]:       <log file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log' append='off'/>
Oct 30 09:16:14 user nova-compute[75017]:       <target type='serial' port='0'/>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='serial0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </console>
Oct 30 09:16:14 user nova-compute[75017]:     <input type='mouse' bus='ps2'>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='input0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </input>
Oct 30 09:16:14 user nova-compute[75017]:     <input type='keyboard' bus='ps2'>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='input1'/>
Oct 30 09:16:14 user nova-compute[75017]:     </input>
Oct 30 09:16:14 user nova-compute[75017]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 30 09:16:14 user nova-compute[75017]:       <listen type='address' address='0.0.0.0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </graphics>
Oct 30 09:16:14 user nova-compute[75017]:     <audio id='1' type='none'/>
Oct 30 09:16:14 user nova-compute[75017]:     <video>
Oct 30 09:16:14 user nova-compute[75017]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='video0'/>
Oct 30 09:16:14 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </video>
Oct 30 09:16:14 user nova-compute[75017]:     <memballoon model='virtio'>
Oct 30 09:16:14 user nova-compute[75017]:       <stats period='10'/>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='balloon0'/>
Oct 30 09:16:14 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </memballoon>
Oct 30 09:16:14 user nova-compute[75017]:     <rng model='virtio'>
Oct 30 09:16:14 user nova-compute[75017]:       <backend model='random'>/dev/urandom</backend>
Oct 30 09:16:14 user nova-compute[75017]:       <alias name='rng0'/>
Oct 30 09:16:14 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 09:16:14 user nova-compute[75017]:     </rng>
Oct 30 09:16:14 user nova-compute[75017]:   </devices>
Oct 30 09:16:14 user nova-compute[75017]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 09:16:14 user nova-compute[75017]:     <label>libvirt-17969235-fc8b-4b25-995b-fdce8b496974</label>
Oct 30 09:16:14 user nova-compute[75017]:     <imagelabel>libvirt-17969235-fc8b-4b25-995b-fdce8b496974</imagelabel>
Oct 30 09:16:14 user nova-compute[75017]:   </seclabel>
Oct 30 09:16:14 user nova-compute[75017]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 09:16:14 user nova-compute[75017]:     <label>+64055:+108</label>
Oct 30 09:16:14 user nova-compute[75017]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 09:16:14 user nova-compute[75017]:   </seclabel>
Oct 30 09:16:14 user nova-compute[75017]: </domain>
Oct 30 09:16:14 user nova-compute[75017]:  {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 09:16:14 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Successfully detached device tapa09feea2-ad from instance 17969235-fc8b-4b25-995b-fdce8b496974 from the persistent domain config.
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] (1/8): Attempting to detach device tapa09feea2-ad with device alias net1 from instance 17969235-fc8b-4b25-995b-fdce8b496974 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] detach device xml: <interface type="ethernet">
Oct 30 09:16:14 user nova-compute[75017]:   <mac address="fa:16:3e:8c:b2:26"/>
Oct 30 09:16:14 user nova-compute[75017]:   <model type="virtio"/>
Oct 30 09:16:14 user nova-compute[75017]:   <mtu size="1442"/>
Oct 30 09:16:14 user nova-compute[75017]:   <target dev="tapa09feea2-ad"/>
Oct 30 09:16:14 user nova-compute[75017]: </interface>
Oct 30 09:16:14 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:16:14 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:14 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=25.424972534179688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.526s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.979s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Cannot resize image /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Ensure instance console log exists: /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.network.neutron [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:16:14 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.policy [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '257ef30aa08d49a387932c340a8589c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20765fc27454d25a1f53e540a8cb4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Start waiting for the detach event from libvirt for device tapa09feea2-ad with device alias net1 for instance 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:16:14 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Creating image(s)
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-8bd0f8a7-35be-451d-b303-dbd1fe2fbb05 req-cf2bbf39-8a13-43d8-ac36-ef91cb088755 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-unplugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8bd0f8a7-35be-451d-b303-dbd1fe2fbb05 req-cf2bbf39-8a13-43d8-ac36-ef91cb088755 service nova] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8bd0f8a7-35be-451d-b303-dbd1fe2fbb05 req-cf2bbf39-8a13-43d8-ac36-ef91cb088755 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8bd0f8a7-35be-451d-b303-dbd1fe2fbb05 req-cf2bbf39-8a13-43d8-ac36-ef91cb088755 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-8bd0f8a7-35be-451d-b303-dbd1fe2fbb05 req-cf2bbf39-8a13-43d8-ac36-ef91cb088755 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] No waiting events found dispatching network-vif-unplugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:15 user nova-compute[75017]: WARNING nova.compute.manager [req-8bd0f8a7-35be-451d-b303-dbd1fe2fbb05 req-cf2bbf39-8a13-43d8-ac36-ef91cb088755 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received unexpected event network-vif-unplugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 for instance with vm_state active and task_state None.
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.236s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Successfully updated port: bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquired lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-3f37bd82-badc-46a2-8405-943ae72bd38c req-bdf862a7-d18b-4a31-8034-388d1babe528 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-changed-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-3f37bd82-badc-46a2-8405-943ae72bd38c req-bdf862a7-d18b-4a31-8034-388d1babe528 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Refreshing instance network info cache due to event network-changed-bc2ab399-b4af-40af-b756-74b48450eb12. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3f37bd82-badc-46a2-8405-943ae72bd38c req-bdf862a7-d18b-4a31-8034-388d1babe528 service nova] Acquiring lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.757s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.377s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:16:15 user nova-compute[75017]: INFO nova.compute.claims [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Claim successful on node user
Oct 30 09:16:15 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Deleted allocations for instance 963c57ec-14d7-43c1-a8dc-7a062446a559
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.253s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk 1073741824" returned: 0 in 0.065s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-74a5b772-de19-4dfe-820a-90024197932a tempest-AttachSCSIVolumeTestJSON-525777381 tempest-AttachSCSIVolumeTestJSON-525777381-project-member] Lock "963c57ec-14d7-43c1-a8dc-7a062446a559" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.603s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updating instance_info_cache with network_info: [{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Successfully created port: 8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Releasing lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Instance network_info: |[{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3f37bd82-badc-46a2-8405-943ae72bd38c req-bdf862a7-d18b-4a31-8034-388d1babe528 service nova] Acquired lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-3f37bd82-badc-46a2-8405-943ae72bd38c req-bdf862a7-d18b-4a31-8034-388d1babe528 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Refreshing network info cache for port bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Start _get_guest_xml network_info=[{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:16:15 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:15 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1708607494',display_name='tempest-ServerRescueNegativeTestJSON-server-1708607494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1708607494',id=13,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-skov6gww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:13Z,user_data=None,user_id='e7b340dac0544150bc642f7ecfb07157',uuid=c6aae433-005c-4b50-9006-d71bca0f8368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:eb:56,bridge_name='br-int',has_traffic_filtering=True,id=bc2ab399-b4af-40af-b756-74b48450eb12,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc2ab399-b4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.objects.instance [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'pci_devices' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:16:15 user nova-compute[75017]:   <uuid>c6aae433-005c-4b50-9006-d71bca0f8368</uuid>
Oct 30 09:16:15 user nova-compute[75017]:   <name>instance-0000000d</name>
Oct 30 09:16:15 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:16:15 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:16:15 user nova-compute[75017]:   <metadata>
Oct 30 09:16:15 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:15 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:16:15 user nova-compute[75017]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1708607494</nova:name>
Oct 30 09:16:15 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:16:15</nova:creationTime>
Oct 30 09:16:15 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:16:15 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:16:15 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:16:15 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:16:15 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:15 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:15 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:16:15 user nova-compute[75017]:       <nova:owner>
Oct 30 09:16:15 user nova-compute[75017]:         <nova:user uuid="e7b340dac0544150bc642f7ecfb07157">tempest-ServerRescueNegativeTestJSON-1002551965-project-member</nova:user>
Oct 30 09:16:15 user nova-compute[75017]:         <nova:project uuid="8c1e0e03de5c497a94c9c6267e623573">tempest-ServerRescueNegativeTestJSON-1002551965</nova:project>
Oct 30 09:16:15 user nova-compute[75017]:       </nova:owner>
Oct 30 09:16:15 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:15 user nova-compute[75017]:       <nova:ports>
Oct 30 09:16:15 user nova-compute[75017]:         <nova:port uuid="bc2ab399-b4af-40af-b756-74b48450eb12">
Oct 30 09:16:15 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 09:16:15 user nova-compute[75017]:         </nova:port>
Oct 30 09:16:15 user nova-compute[75017]:       </nova:ports>
Oct 30 09:16:15 user nova-compute[75017]:     </nova:instance>
Oct 30 09:16:15 user nova-compute[75017]:   </metadata>
Oct 30 09:16:15 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:16:15 user nova-compute[75017]:     <system>
Oct 30 09:16:15 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:16:15 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:16:15 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:16:15 user nova-compute[75017]:       <entry name="serial">c6aae433-005c-4b50-9006-d71bca0f8368</entry>
Oct 30 09:16:15 user nova-compute[75017]:       <entry name="uuid">c6aae433-005c-4b50-9006-d71bca0f8368</entry>
Oct 30 09:16:15 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:16:15 user nova-compute[75017]:     </system>
Oct 30 09:16:15 user nova-compute[75017]:   </sysinfo>
Oct 30 09:16:15 user nova-compute[75017]:   <os>
Oct 30 09:16:15 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:16:15 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:16:15 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:16:15 user nova-compute[75017]:   </os>
Oct 30 09:16:15 user nova-compute[75017]:   <features>
Oct 30 09:16:15 user nova-compute[75017]:     <acpi/>
Oct 30 09:16:15 user nova-compute[75017]:     <apic/>
Oct 30 09:16:15 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:16:15 user nova-compute[75017]:   </features>
Oct 30 09:16:15 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:16:15 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:16:15 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:16:15 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:16:15 user nova-compute[75017]:   </clock>
Oct 30 09:16:15 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:16:15 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:16:15 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:16:15 user nova-compute[75017]:   </cpu>
Oct 30 09:16:15 user nova-compute[75017]:   <devices>
Oct 30 09:16:15 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:16:15 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:16:15 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk"/>
Oct 30 09:16:15 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:16:15 user nova-compute[75017]:     </disk>
Oct 30 09:16:15 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:16:15 user nova-compute[75017]:       <mac address="fa:16:3e:53:eb:56"/>
Oct 30 09:16:15 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:16:15 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:16:15 user nova-compute[75017]:       <target dev="tapbc2ab399-b4"/>
Oct 30 09:16:15 user nova-compute[75017]:     </interface>
Oct 30 09:16:15 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:16:15 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/console.log" append="off"/>
Oct 30 09:16:15 user nova-compute[75017]:     </serial>
Oct 30 09:16:15 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:16:15 user nova-compute[75017]:     <video>
Oct 30 09:16:15 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:16:15 user nova-compute[75017]:     </video>
Oct 30 09:16:15 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:16:15 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:16:15 user nova-compute[75017]:     </rng>
Oct 30 09:16:15 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:16:15 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:16:15 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:16:15 user nova-compute[75017]:     </memballoon>
Oct 30 09:16:15 user nova-compute[75017]:   </devices>
Oct 30 09:16:15 user nova-compute[75017]: </domain>
Oct 30 09:16:15 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1708607494',display_name='tempest-ServerRescueNegativeTestJSON-server-1708607494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1708607494',id=13,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-skov6gww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:13Z,user_data=None,user_id='e7b340dac0544150bc642f7ecfb07157',uuid=c6aae433-005c-4b50-9006-d71bca0f8368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:eb:56,bridge_name='br-int',has_traffic_filtering=True,id=bc2ab399-b4af-40af-b756-74b48450eb12,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc2ab399-b4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG os_vif [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:eb:56,bridge_name='br-int',has_traffic_filtering=True,id=bc2ab399-b4af-40af-b756-74b48450eb12,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc2ab399-b4') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Cannot resize image /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Ensure instance console log exists: /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3708e05-efbc-5b95-8ac6-d5aaa17682a7', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc2ab399-b4, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc2ab399-b4, col_values=(('qos', UUID('3d9cb8d7-87a5-4cb3-9b7e-4514b6f4999d')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc2ab399-b4, col_values=(('external_ids', {'iface-id': 'bc2ab399-b4af-40af-b756-74b48450eb12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:eb:56', 'vm-uuid': 'c6aae433-005c-4b50-9006-d71bca0f8368'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:16 user nova-compute[75017]: INFO os_vif [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:eb:56,bridge_name='br-int',has_traffic_filtering=True,id=bc2ab399-b4af-40af-b756-74b48450eb12,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc2ab399-b4')
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No VIF found with MAC fa:16:3e:53:eb:56, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.795s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.631s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:16:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.policy [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7b340dac0544150bc642f7ecfb07157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1e0e03de5c497a94c9c6267e623573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 32e25927-79c3-490f-b53a-03d4a6299e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 2d49c6bb-acd9-4101-be6a-640a513e84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d46e94f6-465d-4112-868e-acf8cea4f402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 17969235-fc8b-4b25-995b-fdce8b496974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5a294811-e03d-4034-871d-db6ba2ad721d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 8883aff3-715a-4c96-8969-e41986cad31b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance df215875-673c-4446-afa1-3446ff63edbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:16:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Creating image(s)
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.network.neutron [req-3f37bd82-badc-46a2-8405-943ae72bd38c req-bdf862a7-d18b-4a31-8034-388d1babe528 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updated VIF entry in instance network info cache for port bc2ab399-b4af-40af-b756-74b48450eb12. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.network.neutron [req-3f37bd82-badc-46a2-8405-943ae72bd38c req-bdf862a7-d18b-4a31-8034-388d1babe528 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updating instance_info_cache with network_info: [{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3f37bd82-badc-46a2-8405-943ae72bd38c req-bdf862a7-d18b-4a31-8034-388d1babe528 service nova] Releasing lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Successfully updated port: 8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "refresh_cache-75bb6699-a0c6-4f04-9fca-b0c20b6c0162" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquired lock "refresh_cache-75bb6699-a0c6-4f04-9fca-b0c20b6c0162" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.238s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-436431f1-b1d9-4156-b863-b22b69befb27 req-8af49788-e036-4680-8084-6a20c4ca3659 service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received event network-changed-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-436431f1-b1d9-4156-b863-b22b69befb27 req-8af49788-e036-4680-8084-6a20c4ca3659 service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Refreshing instance network info cache due to event network-changed-8c6c6da9-86d9-442f-905d-7f96f9dc53cf. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-436431f1-b1d9-4156-b863-b22b69befb27 req-8af49788-e036-4680-8084-6a20c4ca3659 service nova] Acquiring lock "refresh_cache-75bb6699-a0c6-4f04-9fca-b0c20b6c0162" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk 1073741824" returned: 0 in 0.062s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Updating instance_info_cache with network_info: [{"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Releasing lock "refresh_cache-75bb6699-a0c6-4f04-9fca-b0c20b6c0162" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Instance network_info: |[{"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-436431f1-b1d9-4156-b863-b22b69befb27 req-8af49788-e036-4680-8084-6a20c4ca3659 service nova] Acquired lock "refresh_cache-75bb6699-a0c6-4f04-9fca-b0c20b6c0162" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-436431f1-b1d9-4156-b863-b22b69befb27 req-8af49788-e036-4680-8084-6a20c4ca3659 service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Refreshing network info cache for port 8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Start _get_guest_xml network_info=[{"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Successfully created port: 8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:16:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1576787538',display_name='tempest-tempest.common.compute-instance-1576787538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1576787538',id=14,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ0D6pPliPvw56NeAbr78L4cM6urRqlbH/HwVTIC+dhKSceCfYhmC9ZsFcU6onZI0QNuc+Jo53dGW/cYd6EH1dN5NBpAtDlqFj9M8umKfz8L6hmG4gKRGk7vkrHTwKdKg==',key_name='tempest-keypair-717482653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-39dtqb84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=75bb6699-a0c6-4f04-9fca-b0c20b6c0162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.objects.instance [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lazy-loading 'pci_devices' on Instance uuid 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.230s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.132s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:16:17 user nova-compute[75017]:   <uuid>75bb6699-a0c6-4f04-9fca-b0c20b6c0162</uuid>
Oct 30 09:16:17 user nova-compute[75017]:   <name>instance-0000000e</name>
Oct 30 09:16:17 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:16:17 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:16:17 user nova-compute[75017]:   <metadata>
Oct 30 09:16:17 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:17 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:16:17 user nova-compute[75017]:       <nova:name>tempest-tempest.common.compute-instance-1576787538</nova:name>
Oct 30 09:16:17 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:16:17</nova:creationTime>
Oct 30 09:16:17 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:16:17 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:16:17 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:16:17 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:16:17 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:17 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:17 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:16:17 user nova-compute[75017]:       <nova:owner>
Oct 30 09:16:17 user nova-compute[75017]:         <nova:user uuid="257ef30aa08d49a387932c340a8589c5">tempest-ServerActionsTestOtherA-1280782381-project-member</nova:user>
Oct 30 09:16:17 user nova-compute[75017]:         <nova:project uuid="f20765fc27454d25a1f53e540a8cb4fc">tempest-ServerActionsTestOtherA-1280782381</nova:project>
Oct 30 09:16:17 user nova-compute[75017]:       </nova:owner>
Oct 30 09:16:17 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:17 user nova-compute[75017]:       <nova:ports>
Oct 30 09:16:17 user nova-compute[75017]:         <nova:port uuid="8c6c6da9-86d9-442f-905d-7f96f9dc53cf">
Oct 30 09:16:17 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 09:16:17 user nova-compute[75017]:         </nova:port>
Oct 30 09:16:17 user nova-compute[75017]:       </nova:ports>
Oct 30 09:16:17 user nova-compute[75017]:     </nova:instance>
Oct 30 09:16:17 user nova-compute[75017]:   </metadata>
Oct 30 09:16:17 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:16:17 user nova-compute[75017]:     <system>
Oct 30 09:16:17 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:16:17 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:16:17 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:16:17 user nova-compute[75017]:       <entry name="serial">75bb6699-a0c6-4f04-9fca-b0c20b6c0162</entry>
Oct 30 09:16:17 user nova-compute[75017]:       <entry name="uuid">75bb6699-a0c6-4f04-9fca-b0c20b6c0162</entry>
Oct 30 09:16:17 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:16:17 user nova-compute[75017]:     </system>
Oct 30 09:16:17 user nova-compute[75017]:   </sysinfo>
Oct 30 09:16:17 user nova-compute[75017]:   <os>
Oct 30 09:16:17 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:16:17 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:16:17 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:16:17 user nova-compute[75017]:   </os>
Oct 30 09:16:17 user nova-compute[75017]:   <features>
Oct 30 09:16:17 user nova-compute[75017]:     <acpi/>
Oct 30 09:16:17 user nova-compute[75017]:     <apic/>
Oct 30 09:16:17 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:16:17 user nova-compute[75017]:   </features>
Oct 30 09:16:17 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:16:17 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:16:17 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:16:17 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:16:17 user nova-compute[75017]:   </clock>
Oct 30 09:16:17 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:16:17 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:16:17 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:16:17 user nova-compute[75017]:   </cpu>
Oct 30 09:16:17 user nova-compute[75017]:   <devices>
Oct 30 09:16:17 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:16:17 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:16:17 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk"/>
Oct 30 09:16:17 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:16:17 user nova-compute[75017]:     </disk>
Oct 30 09:16:17 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:16:17 user nova-compute[75017]:       <mac address="fa:16:3e:7d:00:b5"/>
Oct 30 09:16:17 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:16:17 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:16:17 user nova-compute[75017]:       <target dev="tap8c6c6da9-86"/>
Oct 30 09:16:17 user nova-compute[75017]:     </interface>
Oct 30 09:16:17 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:16:17 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/console.log" append="off"/>
Oct 30 09:16:17 user nova-compute[75017]:     </serial>
Oct 30 09:16:17 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:16:17 user nova-compute[75017]:     <video>
Oct 30 09:16:17 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:16:17 user nova-compute[75017]:     </video>
Oct 30 09:16:17 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:16:17 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:16:17 user nova-compute[75017]:     </rng>
Oct 30 09:16:17 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:16:17 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:16:17 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:16:17 user nova-compute[75017]:     </memballoon>
Oct 30 09:16:17 user nova-compute[75017]:   </devices>
Oct 30 09:16:17 user nova-compute[75017]: </domain>
Oct 30 09:16:17 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1576787538',display_name='tempest-tempest.common.compute-instance-1576787538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1576787538',id=14,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ0D6pPliPvw56NeAbr78L4cM6urRqlbH/HwVTIC+dhKSceCfYhmC9ZsFcU6onZI0QNuc+Jo53dGW/cYd6EH1dN5NBpAtDlqFj9M8umKfz8L6hmG4gKRGk7vkrHTwKdKg==',key_name='tempest-keypair-717482653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-39dtqb84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=75bb6699-a0c6-4f04-9fca-b0c20b6c0162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG os_vif [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-d62ec444-6ea0-431d-8f32-c9958ad01a68 req-9f4632b4-7a57-4ce7-a5d7-6455c6ccd1d3 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-plugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d62ec444-6ea0-431d-8f32-c9958ad01a68 req-9f4632b4-7a57-4ce7-a5d7-6455c6ccd1d3 service nova] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d62ec444-6ea0-431d-8f32-c9958ad01a68 req-9f4632b4-7a57-4ce7-a5d7-6455c6ccd1d3 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d62ec444-6ea0-431d-8f32-c9958ad01a68 req-9f4632b4-7a57-4ce7-a5d7-6455c6ccd1d3 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-d62ec444-6ea0-431d-8f32-c9958ad01a68 req-9f4632b4-7a57-4ce7-a5d7-6455c6ccd1d3 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] No waiting events found dispatching network-vif-plugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:17 user nova-compute[75017]: WARNING nova.compute.manager [req-d62ec444-6ea0-431d-8f32-c9958ad01a68 req-9f4632b4-7a57-4ce7-a5d7-6455c6ccd1d3 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received unexpected event network-vif-plugged-a09feea2-ad99-45ce-a6f3-4286f4f7e063 for instance with vm_state active and task_state None.
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0397226-bf46-540a-aaec-6a3ff9eec483', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c6c6da9-86, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c6c6da9-86, col_values=(('qos', UUID('5bb18499-dbe0-467b-8ecd-17eedb3e0301')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c6c6da9-86, col_values=(('external_ids', {'iface-id': '8c6c6da9-86d9-442f-905d-7f96f9dc53cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:00:b5', 'vm-uuid': '75bb6699-a0c6-4f04-9fca-b0c20b6c0162'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:17 user nova-compute[75017]: INFO os_vif [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86')
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Cannot resize image /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Ensure instance console log exists: /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No VIF found with MAC fa:16:3e:7d:00:b5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-436431f1-b1d9-4156-b863-b22b69befb27 req-8af49788-e036-4680-8084-6a20c4ca3659 service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Updated VIF entry in instance network info cache for port 8c6c6da9-86d9-442f-905d-7f96f9dc53cf. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-436431f1-b1d9-4156-b863-b22b69befb27 req-8af49788-e036-4680-8084-6a20c4ca3659 service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Updating instance_info_cache with network_info: [{"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-436431f1-b1d9-4156-b863-b22b69befb27 req-8af49788-e036-4680-8084-6a20c4ca3659 service nova] Releasing lock "refresh_cache-75bb6699-a0c6-4f04-9fca-b0c20b6c0162" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Successfully updated port: 8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquired lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updating instance_info_cache with network_info: [{"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Releasing lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Instance network_info: |[{"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Start _get_guest_xml network_info=[{"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:16:18 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:18 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1187124425',display_name='tempest-ServerRescueNegativeTestJSON-server-1187124425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1187124425',id=15,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-3v4aele9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:16Z,user_data=None,user_id='e7b340dac0544150bc642f7ecfb07157',uuid=7ce43b8f-adcf-4650-9b56-8558ca386fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:af:95,bridge_name='br-int',has_traffic_filtering=True,id=8099d535-21b3-4fcb-90eb-5680fb503fa1,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099d535-21') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:16:18 user nova-compute[75017]:   <uuid>7ce43b8f-adcf-4650-9b56-8558ca386fe7</uuid>
Oct 30 09:16:18 user nova-compute[75017]:   <name>instance-0000000f</name>
Oct 30 09:16:18 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:16:18 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:16:18 user nova-compute[75017]:   <metadata>
Oct 30 09:16:18 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:18 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:16:18 user nova-compute[75017]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1187124425</nova:name>
Oct 30 09:16:18 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:16:18</nova:creationTime>
Oct 30 09:16:18 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:16:18 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:16:18 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:16:18 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:16:18 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:18 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:18 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:16:18 user nova-compute[75017]:       <nova:owner>
Oct 30 09:16:18 user nova-compute[75017]:         <nova:user uuid="e7b340dac0544150bc642f7ecfb07157">tempest-ServerRescueNegativeTestJSON-1002551965-project-member</nova:user>
Oct 30 09:16:18 user nova-compute[75017]:         <nova:project uuid="8c1e0e03de5c497a94c9c6267e623573">tempest-ServerRescueNegativeTestJSON-1002551965</nova:project>
Oct 30 09:16:18 user nova-compute[75017]:       </nova:owner>
Oct 30 09:16:18 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:18 user nova-compute[75017]:       <nova:ports>
Oct 30 09:16:18 user nova-compute[75017]:         <nova:port uuid="8099d535-21b3-4fcb-90eb-5680fb503fa1">
Oct 30 09:16:18 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 09:16:18 user nova-compute[75017]:         </nova:port>
Oct 30 09:16:18 user nova-compute[75017]:       </nova:ports>
Oct 30 09:16:18 user nova-compute[75017]:     </nova:instance>
Oct 30 09:16:18 user nova-compute[75017]:   </metadata>
Oct 30 09:16:18 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:16:18 user nova-compute[75017]:     <system>
Oct 30 09:16:18 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:16:18 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:16:18 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:16:18 user nova-compute[75017]:       <entry name="serial">7ce43b8f-adcf-4650-9b56-8558ca386fe7</entry>
Oct 30 09:16:18 user nova-compute[75017]:       <entry name="uuid">7ce43b8f-adcf-4650-9b56-8558ca386fe7</entry>
Oct 30 09:16:18 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:16:18 user nova-compute[75017]:     </system>
Oct 30 09:16:18 user nova-compute[75017]:   </sysinfo>
Oct 30 09:16:18 user nova-compute[75017]:   <os>
Oct 30 09:16:18 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:16:18 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:16:18 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:16:18 user nova-compute[75017]:   </os>
Oct 30 09:16:18 user nova-compute[75017]:   <features>
Oct 30 09:16:18 user nova-compute[75017]:     <acpi/>
Oct 30 09:16:18 user nova-compute[75017]:     <apic/>
Oct 30 09:16:18 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:16:18 user nova-compute[75017]:   </features>
Oct 30 09:16:18 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:16:18 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:16:18 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:16:18 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:16:18 user nova-compute[75017]:   </clock>
Oct 30 09:16:18 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:16:18 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:16:18 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:16:18 user nova-compute[75017]:   </cpu>
Oct 30 09:16:18 user nova-compute[75017]:   <devices>
Oct 30 09:16:18 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:16:18 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:16:18 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk"/>
Oct 30 09:16:18 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:16:18 user nova-compute[75017]:     </disk>
Oct 30 09:16:18 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:16:18 user nova-compute[75017]:       <mac address="fa:16:3e:2f:af:95"/>
Oct 30 09:16:18 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:16:18 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:16:18 user nova-compute[75017]:       <target dev="tap8099d535-21"/>
Oct 30 09:16:18 user nova-compute[75017]:     </interface>
Oct 30 09:16:18 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:16:18 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/console.log" append="off"/>
Oct 30 09:16:18 user nova-compute[75017]:     </serial>
Oct 30 09:16:18 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:16:18 user nova-compute[75017]:     <video>
Oct 30 09:16:18 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:16:18 user nova-compute[75017]:     </video>
Oct 30 09:16:18 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:16:18 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:16:18 user nova-compute[75017]:     </rng>
Oct 30 09:16:18 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:16:18 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:16:18 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:16:18 user nova-compute[75017]:     </memballoon>
Oct 30 09:16:18 user nova-compute[75017]:   </devices>
Oct 30 09:16:18 user nova-compute[75017]: </domain>
Oct 30 09:16:18 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1187124425',display_name='tempest-ServerRescueNegativeTestJSON-server-1187124425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1187124425',id=15,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-3v4aele9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:16Z,user_data=None,user_id='e7b340dac0544150bc642f7ecfb07157',uuid=7ce43b8f-adcf-4650-9b56-8558ca386fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:af:95,bridge_name='br-int',has_traffic_filtering=True,id=8099d535-21b3-4fcb-90eb-5680fb503fa1,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099d535-21') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG os_vif [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:af:95,bridge_name='br-int',has_traffic_filtering=True,id=8099d535-21b3-4fcb-90eb-5680fb503fa1,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099d535-21') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57a9c4dc-5d72-511a-bbf6-913806f1d892', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8099d535-21, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8099d535-21, col_values=(('qos', UUID('e926edce-106d-41ec-8eb2-60d06d10540c')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8099d535-21, col_values=(('external_ids', {'iface-id': '8099d535-21b3-4fcb-90eb-5680fb503fa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:af:95', 'vm-uuid': '7ce43b8f-adcf-4650-9b56-8558ca386fe7'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:18 user nova-compute[75017]: INFO os_vif [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:af:95,bridge_name='br-int',has_traffic_filtering=True,id=8099d535-21b3-4fcb-90eb-5680fb503fa1,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099d535-21')
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No VIF found with MAC fa:16:3e:2f:af:95, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:18 user nova-compute[75017]: WARNING nova.compute.manager [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state building and task_state spawning.
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:18 user nova-compute[75017]: WARNING nova.compute.manager [req-e79d23be-e1a6-48c5-ba37-00f46aec1a07 req-cc9b2e7a-6485-47e4-9b1b-833f3a66dfb7 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state building and task_state spawning.
Oct 30 09:16:19 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updating instance_info_cache with network_info: [{"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ede7b88-1e5d-412e-bb61-07c79a2b63b6 req-81375a08-d4ea-45dc-a2fe-220c007d078b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-changed-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ede7b88-1e5d-412e-bb61-07c79a2b63b6 req-81375a08-d4ea-45dc-a2fe-220c007d078b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Refreshing instance network info cache due to event network-changed-8099d535-21b3-4fcb-90eb-5680fb503fa1. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ede7b88-1e5d-412e-bb61-07c79a2b63b6 req-81375a08-d4ea-45dc-a2fe-220c007d078b service nova] Acquiring lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ede7b88-1e5d-412e-bb61-07c79a2b63b6 req-81375a08-d4ea-45dc-a2fe-220c007d078b service nova] Acquired lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-8ede7b88-1e5d-412e-bb61-07c79a2b63b6 req-81375a08-d4ea-45dc-a2fe-220c007d078b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Refreshing network info cache for port 8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-8ede7b88-1e5d-412e-bb61-07c79a2b63b6 req-81375a08-d4ea-45dc-a2fe-220c007d078b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updated VIF entry in instance network info cache for port 8099d535-21b3-4fcb-90eb-5680fb503fa1. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-8ede7b88-1e5d-412e-bb61-07c79a2b63b6 req-81375a08-d4ea-45dc-a2fe-220c007d078b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updating instance_info_cache with network_info: [{"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ede7b88-1e5d-412e-bb61-07c79a2b63b6 req-81375a08-d4ea-45dc-a2fe-220c007d078b service nova] Releasing lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-01c41891-423c-4326-a488-e3fd7ea1d640 req-d7d582fb-0fac-4e6f-ac4a-6347352e9e8f service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-01c41891-423c-4326-a488-e3fd7ea1d640 req-d7d582fb-0fac-4e6f-ac4a-6347352e9e8f service nova] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-01c41891-423c-4326-a488-e3fd7ea1d640 req-d7d582fb-0fac-4e6f-ac4a-6347352e9e8f service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-01c41891-423c-4326-a488-e3fd7ea1d640 req-d7d582fb-0fac-4e6f-ac4a-6347352e9e8f service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-01c41891-423c-4326-a488-e3fd7ea1d640 req-d7d582fb-0fac-4e6f-ac4a-6347352e9e8f service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] No waiting events found dispatching network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:20 user nova-compute[75017]: WARNING nova.compute.manager [req-01c41891-423c-4326-a488-e3fd7ea1d640 req-d7d582fb-0fac-4e6f-ac4a-6347352e9e8f service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received unexpected event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf for instance with vm_state building and task_state spawning.
Oct 30 09:16:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:16:22 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Instance spawned successfully.
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:22 user nova-compute[75017]: INFO nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Took 9.50 seconds to spawn the instance on the hypervisor.
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:16:22 user nova-compute[75017]: INFO nova.compute.manager [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Took 10.86 seconds to build instance.
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-577acdc4-53bb-4dec-87eb-157634ca87c5 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "c6aae433-005c-4b50-9006-d71bca0f8368" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.008s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] No waiting events found dispatching network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:22 user nova-compute[75017]: WARNING nova.compute.manager [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received unexpected event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf for instance with vm_state building and task_state spawning.
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] No waiting events found dispatching network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:22 user nova-compute[75017]: WARNING nova.compute.manager [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received unexpected event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 for instance with vm_state building and task_state spawning.
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] No waiting events found dispatching network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:22 user nova-compute[75017]: WARNING nova.compute.manager [req-6bad789a-0e1b-48cd-a27a-dcdf15a14a1e req-934797a9-c9a7-4ff0-83d9-b984861b6e1b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received unexpected event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 for instance with vm_state building and task_state spawning.
Oct 30 09:16:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:16:23 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Instance spawned successfully.
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:16:23 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Instance spawned successfully.
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:23 user nova-compute[75017]: INFO nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Took 9.08 seconds to spawn the instance on the hypervisor.
Oct 30 09:16:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:16:24 user nova-compute[75017]: INFO nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Took 7.59 seconds to spawn the instance on the hypervisor.
Oct 30 09:16:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:16:24 user nova-compute[75017]: INFO nova.compute.manager [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Took 12.01 seconds to build instance.
Oct 30 09:16:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eac249b1-2fcb-4c21-8623-2e33964cb331 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.210s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:24 user nova-compute[75017]: INFO nova.compute.manager [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Took 11.32 seconds to build instance.
Oct 30 09:16:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c509daa3-be8d-4a0e-ac21-7005f1069d4b tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.456s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-a9b3f850-643f-4be8-983c-5ed98457ed66 req-e5c86e85-b2f2-4810-bdc3-d05f64563c7d service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event volume-reimaged-3a9871b3-cec4-447d-89c0-aa4d20fa3244 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a9b3f850-643f-4be8-983c-5ed98457ed66 req-e5c86e85-b2f2-4810-bdc3-d05f64563c7d service nova] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a9b3f850-643f-4be8-983c-5ed98457ed66 req-e5c86e85-b2f2-4810-bdc3-d05f64563c7d service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a9b3f850-643f-4be8-983c-5ed98457ed66 req-e5c86e85-b2f2-4810-bdc3-d05f64563c7d service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-a9b3f850-643f-4be8-983c-5ed98457ed66 req-e5c86e85-b2f2-4810-bdc3-d05f64563c7d service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Processing event volume-reimaged-3a9871b3-cec4-447d-89c0-aa4d20fa3244 {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance event wait completed in 34 seconds for volume-reimaged {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:16:25 user nova-compute[75017]: INFO nova.virt.block_device [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Booting with volume 3a9871b3-cec4-447d-89c0-aa4d20fa3244 at /dev/vda
Oct 30 09:16:25 user nova-compute[75017]: DEBUG os_brick.utils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8f7da8-19c9-4a4d-800d-405e84948156]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9262be-b577-4d6c-a3c8-098e47754459]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[418238b5-78d2-4f92-b001-b96110e430ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab01eae-8d3a-49ca-bc02-a0e6fd55ad69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:16:25 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:16:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc67e291-832e-430f-9562-dfd8d734105b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG os_brick.utils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:16:25 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Updating existing volume attachment record: e8cae09f-92d3-425e-a828-bb809e03cc91 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:16:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:34 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Waiting for libvirt event about the detach of device tapa09feea2-ad with device alias net1 from instance 17969235-fc8b-4b25-995b-fdce8b496974 is timed out.
Oct 30 09:16:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface> {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 30 09:16:34 user nova-compute[75017]:   <name>instance-00000007</name>
Oct 30 09:16:34 user nova-compute[75017]:   <uuid>17969235-fc8b-4b25-995b-fdce8b496974</uuid>
Oct 30 09:16:34 user nova-compute[75017]:   <metadata>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:34 user nova-compute[75017]:   <nova:package version="0.0.0"/>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:name>tempest-device-tagging-server-57449668</nova:name>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:creationTime>2023-10-30 09:14:47</nova:creationTime>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:flavor name="m1.tiny">
Oct 30 09:16:34 user nova-compute[75017]:     <nova:memory>512</nova:memory>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:disk>1</nova:disk>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:swap>0</nova:swap>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:34 user nova-compute[75017]:   </nova:flavor>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:owner>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:user uuid="72543d1c58b7444aa36e252b59f33625">tempest-TaggedAttachmentsTest-2138896194-project-member</nova:user>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:project uuid="2cbfa2cb0b7e442eb6a91f94df21dbe0">tempest-TaggedAttachmentsTest-2138896194</nova:project>
Oct 30 09:16:34 user nova-compute[75017]:   </nova:owner>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:ports>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:port uuid="840e6749-42d0-4bb0-9787-a348ca450fe7">
Oct 30 09:16:34 user nova-compute[75017]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:16:34 user nova-compute[75017]:     </nova:port>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:port uuid="a09feea2-ad99-45ce-a6f3-4286f4f7e063">
Oct 30 09:16:34 user nova-compute[75017]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Oct 30 09:16:34 user nova-compute[75017]:     </nova:port>
Oct 30 09:16:34 user nova-compute[75017]:   </nova:ports>
Oct 30 09:16:34 user nova-compute[75017]: </nova:instance>
Oct 30 09:16:34 user nova-compute[75017]:   </metadata>
Oct 30 09:16:34 user nova-compute[75017]:   <memory unit='KiB'>524288</memory>
Oct 30 09:16:34 user nova-compute[75017]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 09:16:34 user nova-compute[75017]:   <vcpu placement='static'>1</vcpu>
Oct 30 09:16:34 user nova-compute[75017]:   <resource>
Oct 30 09:16:34 user nova-compute[75017]:     <partition>/machine</partition>
Oct 30 09:16:34 user nova-compute[75017]:   </resource>
Oct 30 09:16:34 user nova-compute[75017]:   <sysinfo type='smbios'>
Oct 30 09:16:34 user nova-compute[75017]:     <system>
Oct 30 09:16:34 user nova-compute[75017]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 09:16:34 user nova-compute[75017]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 09:16:34 user nova-compute[75017]:       <entry name='version'>0.0.0</entry>
Oct 30 09:16:34 user nova-compute[75017]:       <entry name='serial'>17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:16:34 user nova-compute[75017]:       <entry name='uuid'>17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:16:34 user nova-compute[75017]:       <entry name='family'>Virtual Machine</entry>
Oct 30 09:16:34 user nova-compute[75017]:     </system>
Oct 30 09:16:34 user nova-compute[75017]:   </sysinfo>
Oct 30 09:16:34 user nova-compute[75017]:   <os>
Oct 30 09:16:34 user nova-compute[75017]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 09:16:34 user nova-compute[75017]:     <boot dev='hd'/>
Oct 30 09:16:34 user nova-compute[75017]:     <smbios mode='sysinfo'/>
Oct 30 09:16:34 user nova-compute[75017]:   </os>
Oct 30 09:16:34 user nova-compute[75017]:   <features>
Oct 30 09:16:34 user nova-compute[75017]:     <acpi/>
Oct 30 09:16:34 user nova-compute[75017]:     <apic/>
Oct 30 09:16:34 user nova-compute[75017]:     <vmcoreinfo state='on'/>
Oct 30 09:16:34 user nova-compute[75017]:   </features>
Oct 30 09:16:34 user nova-compute[75017]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 09:16:34 user nova-compute[75017]:     <model fallback='forbid'>Nehalem</model>
Oct 30 09:16:34 user nova-compute[75017]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 09:16:34 user nova-compute[75017]:     <feature policy='require' name='vme'/>
Oct 30 09:16:34 user nova-compute[75017]:     <feature policy='require' name='x2apic'/>
Oct 30 09:16:34 user nova-compute[75017]:     <feature policy='require' name='hypervisor'/>
Oct 30 09:16:34 user nova-compute[75017]:   </cpu>
Oct 30 09:16:34 user nova-compute[75017]:   <clock offset='utc'>
Oct 30 09:16:34 user nova-compute[75017]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 09:16:34 user nova-compute[75017]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 09:16:34 user nova-compute[75017]:     <timer name='hpet' present='no'/>
Oct 30 09:16:34 user nova-compute[75017]:   </clock>
Oct 30 09:16:34 user nova-compute[75017]:   <on_poweroff>destroy</on_poweroff>
Oct 30 09:16:34 user nova-compute[75017]:   <on_reboot>restart</on_reboot>
Oct 30 09:16:34 user nova-compute[75017]:   <on_crash>destroy</on_crash>
Oct 30 09:16:34 user nova-compute[75017]:   <devices>
Oct 30 09:16:34 user nova-compute[75017]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 09:16:34 user nova-compute[75017]:     <disk type='file' device='disk'>
Oct 30 09:16:34 user nova-compute[75017]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 09:16:34 user nova-compute[75017]:       <source file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk' index='2'/>
Oct 30 09:16:34 user nova-compute[75017]:       <backingStore type='file' index='3'>
Oct 30 09:16:34 user nova-compute[75017]:         <format type='raw'/>
Oct 30 09:16:34 user nova-compute[75017]:         <source file='/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1'/>
Oct 30 09:16:34 user nova-compute[75017]:         <backingStore/>
Oct 30 09:16:34 user nova-compute[75017]:       </backingStore>
Oct 30 09:16:34 user nova-compute[75017]:       <target dev='vda' bus='virtio'/>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='virtio-disk0'/>
Oct 30 09:16:34 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </disk>
Oct 30 09:16:34 user nova-compute[75017]:     <disk type='file' device='cdrom'>
Oct 30 09:16:34 user nova-compute[75017]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 09:16:34 user nova-compute[75017]:       <source file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.config' index='1'/>
Oct 30 09:16:34 user nova-compute[75017]:       <backingStore/>
Oct 30 09:16:34 user nova-compute[75017]:       <target dev='hda' bus='ide'/>
Oct 30 09:16:34 user nova-compute[75017]:       <readonly/>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='ide0-0-0'/>
Oct 30 09:16:34 user nova-compute[75017]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </disk>
Oct 30 09:16:34 user nova-compute[75017]:     <controller type='usb' index='0' model='none'>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='usb'/>
Oct 30 09:16:34 user nova-compute[75017]:     </controller>
Oct 30 09:16:34 user nova-compute[75017]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='pci.0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </controller>
Oct 30 09:16:34 user nova-compute[75017]:     <controller type='ide' index='0'>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='ide'/>
Oct 30 09:16:34 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 09:16:34 user nova-compute[75017]:     </controller>
Oct 30 09:16:34 user nova-compute[75017]:     <interface type='ethernet'>
Oct 30 09:16:34 user nova-compute[75017]:       <mac address='fa:16:3e:3a:5d:f7'/>
Oct 30 09:16:34 user nova-compute[75017]:       <target dev='tap840e6749-42'/>
Oct 30 09:16:34 user nova-compute[75017]:       <model type='virtio'/>
Oct 30 09:16:34 user nova-compute[75017]:       <mtu size='1442'/>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='net0'/>
Oct 30 09:16:34 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </interface>
Oct 30 09:16:34 user nova-compute[75017]:     <serial type='pty'>
Oct 30 09:16:34 user nova-compute[75017]:       <source path='/dev/pts/5'/>
Oct 30 09:16:34 user nova-compute[75017]:       <log file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log' append='off'/>
Oct 30 09:16:34 user nova-compute[75017]:       <target type='isa-serial' port='0'>
Oct 30 09:16:34 user nova-compute[75017]:         <model name='isa-serial'/>
Oct 30 09:16:34 user nova-compute[75017]:       </target>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='serial0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </serial>
Oct 30 09:16:34 user nova-compute[75017]:     <console type='pty' tty='/dev/pts/5'>
Oct 30 09:16:34 user nova-compute[75017]:       <source path='/dev/pts/5'/>
Oct 30 09:16:34 user nova-compute[75017]:       <log file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log' append='off'/>
Oct 30 09:16:34 user nova-compute[75017]:       <target type='serial' port='0'/>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='serial0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </console>
Oct 30 09:16:34 user nova-compute[75017]:     <input type='mouse' bus='ps2'>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='input0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </input>
Oct 30 09:16:34 user nova-compute[75017]:     <input type='keyboard' bus='ps2'>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='input1'/>
Oct 30 09:16:34 user nova-compute[75017]:     </input>
Oct 30 09:16:34 user nova-compute[75017]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 30 09:16:34 user nova-compute[75017]:       <listen type='address' address='0.0.0.0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </graphics>
Oct 30 09:16:34 user nova-compute[75017]:     <audio id='1' type='none'/>
Oct 30 09:16:34 user nova-compute[75017]:     <video>
Oct 30 09:16:34 user nova-compute[75017]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='video0'/>
Oct 30 09:16:34 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </video>
Oct 30 09:16:34 user nova-compute[75017]:     <memballoon model='virtio'>
Oct 30 09:16:34 user nova-compute[75017]:       <stats period='10'/>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='balloon0'/>
Oct 30 09:16:34 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </memballoon>
Oct 30 09:16:34 user nova-compute[75017]:     <rng model='virtio'>
Oct 30 09:16:34 user nova-compute[75017]:       <backend model='random'>/dev/urandom</backend>
Oct 30 09:16:34 user nova-compute[75017]:       <alias name='rng0'/>
Oct 30 09:16:34 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 09:16:34 user nova-compute[75017]:     </rng>
Oct 30 09:16:34 user nova-compute[75017]:   </devices>
Oct 30 09:16:34 user nova-compute[75017]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 09:16:34 user nova-compute[75017]:     <label>libvirt-17969235-fc8b-4b25-995b-fdce8b496974</label>
Oct 30 09:16:34 user nova-compute[75017]:     <imagelabel>libvirt-17969235-fc8b-4b25-995b-fdce8b496974</imagelabel>
Oct 30 09:16:34 user nova-compute[75017]:   </seclabel>
Oct 30 09:16:34 user nova-compute[75017]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 09:16:34 user nova-compute[75017]:     <label>+64055:+108</label>
Oct 30 09:16:34 user nova-compute[75017]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 09:16:34 user nova-compute[75017]:   </seclabel>
Oct 30 09:16:34 user nova-compute[75017]: </domain>
Oct 30 09:16:34 user nova-compute[75017]:  {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 09:16:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Successfully detached device tapa09feea2-ad from instance 17969235-fc8b-4b25-995b-fdce8b496974 from the live domain config.
Oct 30 09:16:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-57449668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-57449668',id=7,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISm4h9XE1KNjZ2BtaUqmuhfL1YRvfcyLbox2ZePi/EII8ogZ6S4AfZo+/2Z52igxxz2fW/Rx2pXwsmh/8mnYbXpfRpgYHTdJLGwxN4G2z5fHYm02Wr1qLrrUa0GrO3NaQ==',key_name='tempest-keypair-1815186852',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cbfa2cb0b7e442eb6a91f94df21dbe0',ramdisk_id='',reservation_id='r-zhoyj2oj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2138896194',owner_user_name='tempest-TaggedAttachmentsTest-2138896194-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72543d1c58b7444aa36e252b59f33625',uuid=17969235-fc8b-4b25-995b-fdce8b496974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converting VIF {"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG os_vif [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa09feea2-ad, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15c43eca-a558-49a2-a634-980c59187e49) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:34 user nova-compute[75017]: INFO os_vif [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad')
Oct 30 09:16:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:34 user nova-compute[75017]:   <nova:package version="0.0.0"/>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:name>tempest-device-tagging-server-57449668</nova:name>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:creationTime>2023-10-30 09:16:34</nova:creationTime>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:flavor name="m1.tiny">
Oct 30 09:16:34 user nova-compute[75017]:     <nova:memory>512</nova:memory>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:disk>1</nova:disk>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:swap>0</nova:swap>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:34 user nova-compute[75017]:   </nova:flavor>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:owner>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:user uuid="72543d1c58b7444aa36e252b59f33625">tempest-TaggedAttachmentsTest-2138896194-project-member</nova:user>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:project uuid="2cbfa2cb0b7e442eb6a91f94df21dbe0">tempest-TaggedAttachmentsTest-2138896194</nova:project>
Oct 30 09:16:34 user nova-compute[75017]:   </nova:owner>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:34 user nova-compute[75017]:   <nova:ports>
Oct 30 09:16:34 user nova-compute[75017]:     <nova:port uuid="840e6749-42d0-4bb0-9787-a348ca450fe7">
Oct 30 09:16:34 user nova-compute[75017]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:16:34 user nova-compute[75017]:     </nova:port>
Oct 30 09:16:34 user nova-compute[75017]:   </nova:ports>
Oct 30 09:16:34 user nova-compute[75017]: </nova:instance>
Oct 30 09:16:34 user nova-compute[75017]:  {{(pid=75017) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-deleted-a09feea2-ad99-45ce-a6f3-4286f4f7e063 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:35 user nova-compute[75017]: INFO nova.compute.manager [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Neutron deleted interface a09feea2-ad99-45ce-a6f3-4286f4f7e063; detaching it from the instance and deleting it from the info cache
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.network.neutron [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updating instance_info_cache with network_info: [{"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquired lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.objects.instance [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] Lazy-loading 'system_metadata' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.objects.instance [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] Lazy-loading 'flavor' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.objects.base [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] Object Instance<17969235-fc8b-4b25-995b-fdce8b496974> lazy-loaded attributes: system_metadata,flavor {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-57449668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-57449668',id=7,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISm4h9XE1KNjZ2BtaUqmuhfL1YRvfcyLbox2ZePi/EII8ogZ6S4AfZo+/2Z52igxxz2fW/Rx2pXwsmh/8mnYbXpfRpgYHTdJLGwxN4G2z5fHYm02Wr1qLrrUa0GrO3NaQ==',key_name='tempest-keypair-1815186852',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cbfa2cb0b7e442eb6a91f94df21dbe0',ramdisk_id='',reservation_id='r-zhoyj2oj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2138896194',owner_user_name='tempest-TaggedAttachmentsTest-2138896194-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72543d1c58b7444aa36e252b59f33625',uuid=17969235-fc8b-4b25-995b-fdce8b496974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] Converting VIF {"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface> {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 30 09:16:35 user nova-compute[75017]:   <name>instance-00000007</name>
Oct 30 09:16:35 user nova-compute[75017]:   <uuid>17969235-fc8b-4b25-995b-fdce8b496974</uuid>
Oct 30 09:16:35 user nova-compute[75017]:   <metadata>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:35 user nova-compute[75017]:   <nova:package version="0.0.0"/>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:name>tempest-device-tagging-server-57449668</nova:name>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:creationTime>2023-10-30 09:16:34</nova:creationTime>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:flavor name="m1.tiny">
Oct 30 09:16:35 user nova-compute[75017]:     <nova:memory>512</nova:memory>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:disk>1</nova:disk>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:swap>0</nova:swap>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:35 user nova-compute[75017]:   </nova:flavor>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:owner>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:user uuid="72543d1c58b7444aa36e252b59f33625">tempest-TaggedAttachmentsTest-2138896194-project-member</nova:user>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:project uuid="2cbfa2cb0b7e442eb6a91f94df21dbe0">tempest-TaggedAttachmentsTest-2138896194</nova:project>
Oct 30 09:16:35 user nova-compute[75017]:   </nova:owner>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:ports>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:port uuid="840e6749-42d0-4bb0-9787-a348ca450fe7">
Oct 30 09:16:35 user nova-compute[75017]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:16:35 user nova-compute[75017]:     </nova:port>
Oct 30 09:16:35 user nova-compute[75017]:   </nova:ports>
Oct 30 09:16:35 user nova-compute[75017]: </nova:instance>
Oct 30 09:16:35 user nova-compute[75017]:   </metadata>
Oct 30 09:16:35 user nova-compute[75017]:   <memory unit='KiB'>524288</memory>
Oct 30 09:16:35 user nova-compute[75017]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 09:16:35 user nova-compute[75017]:   <vcpu placement='static'>1</vcpu>
Oct 30 09:16:35 user nova-compute[75017]:   <resource>
Oct 30 09:16:35 user nova-compute[75017]:     <partition>/machine</partition>
Oct 30 09:16:35 user nova-compute[75017]:   </resource>
Oct 30 09:16:35 user nova-compute[75017]:   <sysinfo type='smbios'>
Oct 30 09:16:35 user nova-compute[75017]:     <system>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='version'>0.0.0</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='serial'>17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='uuid'>17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='family'>Virtual Machine</entry>
Oct 30 09:16:35 user nova-compute[75017]:     </system>
Oct 30 09:16:35 user nova-compute[75017]:   </sysinfo>
Oct 30 09:16:35 user nova-compute[75017]:   <os>
Oct 30 09:16:35 user nova-compute[75017]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 09:16:35 user nova-compute[75017]:     <boot dev='hd'/>
Oct 30 09:16:35 user nova-compute[75017]:     <smbios mode='sysinfo'/>
Oct 30 09:16:35 user nova-compute[75017]:   </os>
Oct 30 09:16:35 user nova-compute[75017]:   <features>
Oct 30 09:16:35 user nova-compute[75017]:     <acpi/>
Oct 30 09:16:35 user nova-compute[75017]:     <apic/>
Oct 30 09:16:35 user nova-compute[75017]:     <vmcoreinfo state='on'/>
Oct 30 09:16:35 user nova-compute[75017]:   </features>
Oct 30 09:16:35 user nova-compute[75017]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 09:16:35 user nova-compute[75017]:     <model fallback='forbid'>Nehalem</model>
Oct 30 09:16:35 user nova-compute[75017]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 09:16:35 user nova-compute[75017]:     <feature policy='require' name='vme'/>
Oct 30 09:16:35 user nova-compute[75017]:     <feature policy='require' name='x2apic'/>
Oct 30 09:16:35 user nova-compute[75017]:     <feature policy='require' name='hypervisor'/>
Oct 30 09:16:35 user nova-compute[75017]:   </cpu>
Oct 30 09:16:35 user nova-compute[75017]:   <clock offset='utc'>
Oct 30 09:16:35 user nova-compute[75017]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 09:16:35 user nova-compute[75017]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 09:16:35 user nova-compute[75017]:     <timer name='hpet' present='no'/>
Oct 30 09:16:35 user nova-compute[75017]:   </clock>
Oct 30 09:16:35 user nova-compute[75017]:   <on_poweroff>destroy</on_poweroff>
Oct 30 09:16:35 user nova-compute[75017]:   <on_reboot>restart</on_reboot>
Oct 30 09:16:35 user nova-compute[75017]:   <on_crash>destroy</on_crash>
Oct 30 09:16:35 user nova-compute[75017]:   <devices>
Oct 30 09:16:35 user nova-compute[75017]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 09:16:35 user nova-compute[75017]:     <disk type='file' device='disk'>
Oct 30 09:16:35 user nova-compute[75017]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 09:16:35 user nova-compute[75017]:       <source file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk' index='2'/>
Oct 30 09:16:35 user nova-compute[75017]:       <backingStore type='file' index='3'>
Oct 30 09:16:35 user nova-compute[75017]:         <format type='raw'/>
Oct 30 09:16:35 user nova-compute[75017]:         <source file='/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1'/>
Oct 30 09:16:35 user nova-compute[75017]:         <backingStore/>
Oct 30 09:16:35 user nova-compute[75017]:       </backingStore>
Oct 30 09:16:35 user nova-compute[75017]:       <target dev='vda' bus='virtio'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='virtio-disk0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </disk>
Oct 30 09:16:35 user nova-compute[75017]:     <disk type='file' device='cdrom'>
Oct 30 09:16:35 user nova-compute[75017]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 09:16:35 user nova-compute[75017]:       <source file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.config' index='1'/>
Oct 30 09:16:35 user nova-compute[75017]:       <backingStore/>
Oct 30 09:16:35 user nova-compute[75017]:       <target dev='hda' bus='ide'/>
Oct 30 09:16:35 user nova-compute[75017]:       <readonly/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='ide0-0-0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </disk>
Oct 30 09:16:35 user nova-compute[75017]:     <controller type='usb' index='0' model='none'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='usb'/>
Oct 30 09:16:35 user nova-compute[75017]:     </controller>
Oct 30 09:16:35 user nova-compute[75017]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='pci.0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </controller>
Oct 30 09:16:35 user nova-compute[75017]:     <controller type='ide' index='0'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='ide'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 09:16:35 user nova-compute[75017]:     </controller>
Oct 30 09:16:35 user nova-compute[75017]:     <interface type='ethernet'>
Oct 30 09:16:35 user nova-compute[75017]:       <mac address='fa:16:3e:3a:5d:f7'/>
Oct 30 09:16:35 user nova-compute[75017]:       <target dev='tap840e6749-42'/>
Oct 30 09:16:35 user nova-compute[75017]:       <model type='virtio'/>
Oct 30 09:16:35 user nova-compute[75017]:       <mtu size='1442'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='net0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </interface>
Oct 30 09:16:35 user nova-compute[75017]:     <serial type='pty'>
Oct 30 09:16:35 user nova-compute[75017]:       <source path='/dev/pts/5'/>
Oct 30 09:16:35 user nova-compute[75017]:       <log file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log' append='off'/>
Oct 30 09:16:35 user nova-compute[75017]:       <target type='isa-serial' port='0'>
Oct 30 09:16:35 user nova-compute[75017]:         <model name='isa-serial'/>
Oct 30 09:16:35 user nova-compute[75017]:       </target>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='serial0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </serial>
Oct 30 09:16:35 user nova-compute[75017]:     <console type='pty' tty='/dev/pts/5'>
Oct 30 09:16:35 user nova-compute[75017]:       <source path='/dev/pts/5'/>
Oct 30 09:16:35 user nova-compute[75017]:       <log file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log' append='off'/>
Oct 30 09:16:35 user nova-compute[75017]:       <target type='serial' port='0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='serial0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </console>
Oct 30 09:16:35 user nova-compute[75017]:     <input type='mouse' bus='ps2'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='input0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </input>
Oct 30 09:16:35 user nova-compute[75017]:     <input type='keyboard' bus='ps2'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='input1'/>
Oct 30 09:16:35 user nova-compute[75017]:     </input>
Oct 30 09:16:35 user nova-compute[75017]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 30 09:16:35 user nova-compute[75017]:       <listen type='address' address='0.0.0.0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </graphics>
Oct 30 09:16:35 user nova-compute[75017]:     <audio id='1' type='none'/>
Oct 30 09:16:35 user nova-compute[75017]:     <video>
Oct 30 09:16:35 user nova-compute[75017]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='video0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </video>
Oct 30 09:16:35 user nova-compute[75017]:     <memballoon model='virtio'>
Oct 30 09:16:35 user nova-compute[75017]:       <stats period='10'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='balloon0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </memballoon>
Oct 30 09:16:35 user nova-compute[75017]:     <rng model='virtio'>
Oct 30 09:16:35 user nova-compute[75017]:       <backend model='random'>/dev/urandom</backend>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='rng0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </rng>
Oct 30 09:16:35 user nova-compute[75017]:   </devices>
Oct 30 09:16:35 user nova-compute[75017]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 09:16:35 user nova-compute[75017]:     <label>libvirt-17969235-fc8b-4b25-995b-fdce8b496974</label>
Oct 30 09:16:35 user nova-compute[75017]:     <imagelabel>libvirt-17969235-fc8b-4b25-995b-fdce8b496974</imagelabel>
Oct 30 09:16:35 user nova-compute[75017]:   </seclabel>
Oct 30 09:16:35 user nova-compute[75017]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 09:16:35 user nova-compute[75017]:     <label>+64055:+108</label>
Oct 30 09:16:35 user nova-compute[75017]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 09:16:35 user nova-compute[75017]:   </seclabel>
Oct 30 09:16:35 user nova-compute[75017]: </domain>
Oct 30 09:16:35 user nova-compute[75017]:  {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface> {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:b2:26"/><model type="virtio"/><mtu size="1442"/><target dev="tapa09feea2-ad"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 30 09:16:35 user nova-compute[75017]:   <name>instance-00000007</name>
Oct 30 09:16:35 user nova-compute[75017]:   <uuid>17969235-fc8b-4b25-995b-fdce8b496974</uuid>
Oct 30 09:16:35 user nova-compute[75017]:   <metadata>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:35 user nova-compute[75017]:   <nova:package version="0.0.0"/>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:name>tempest-device-tagging-server-57449668</nova:name>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:creationTime>2023-10-30 09:16:34</nova:creationTime>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:flavor name="m1.tiny">
Oct 30 09:16:35 user nova-compute[75017]:     <nova:memory>512</nova:memory>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:disk>1</nova:disk>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:swap>0</nova:swap>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:35 user nova-compute[75017]:   </nova:flavor>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:owner>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:user uuid="72543d1c58b7444aa36e252b59f33625">tempest-TaggedAttachmentsTest-2138896194-project-member</nova:user>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:project uuid="2cbfa2cb0b7e442eb6a91f94df21dbe0">tempest-TaggedAttachmentsTest-2138896194</nova:project>
Oct 30 09:16:35 user nova-compute[75017]:   </nova:owner>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:ports>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:port uuid="840e6749-42d0-4bb0-9787-a348ca450fe7">
Oct 30 09:16:35 user nova-compute[75017]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:16:35 user nova-compute[75017]:     </nova:port>
Oct 30 09:16:35 user nova-compute[75017]:   </nova:ports>
Oct 30 09:16:35 user nova-compute[75017]: </nova:instance>
Oct 30 09:16:35 user nova-compute[75017]:   </metadata>
Oct 30 09:16:35 user nova-compute[75017]:   <memory unit='KiB'>524288</memory>
Oct 30 09:16:35 user nova-compute[75017]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 09:16:35 user nova-compute[75017]:   <vcpu placement='static'>1</vcpu>
Oct 30 09:16:35 user nova-compute[75017]:   <resource>
Oct 30 09:16:35 user nova-compute[75017]:     <partition>/machine</partition>
Oct 30 09:16:35 user nova-compute[75017]:   </resource>
Oct 30 09:16:35 user nova-compute[75017]:   <sysinfo type='smbios'>
Oct 30 09:16:35 user nova-compute[75017]:     <system>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='version'>0.0.0</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='serial'>17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='uuid'>17969235-fc8b-4b25-995b-fdce8b496974</entry>
Oct 30 09:16:35 user nova-compute[75017]:       <entry name='family'>Virtual Machine</entry>
Oct 30 09:16:35 user nova-compute[75017]:     </system>
Oct 30 09:16:35 user nova-compute[75017]:   </sysinfo>
Oct 30 09:16:35 user nova-compute[75017]:   <os>
Oct 30 09:16:35 user nova-compute[75017]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 09:16:35 user nova-compute[75017]:     <boot dev='hd'/>
Oct 30 09:16:35 user nova-compute[75017]:     <smbios mode='sysinfo'/>
Oct 30 09:16:35 user nova-compute[75017]:   </os>
Oct 30 09:16:35 user nova-compute[75017]:   <features>
Oct 30 09:16:35 user nova-compute[75017]:     <acpi/>
Oct 30 09:16:35 user nova-compute[75017]:     <apic/>
Oct 30 09:16:35 user nova-compute[75017]:     <vmcoreinfo state='on'/>
Oct 30 09:16:35 user nova-compute[75017]:   </features>
Oct 30 09:16:35 user nova-compute[75017]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 09:16:35 user nova-compute[75017]:     <model fallback='forbid'>Nehalem</model>
Oct 30 09:16:35 user nova-compute[75017]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 09:16:35 user nova-compute[75017]:     <feature policy='require' name='vme'/>
Oct 30 09:16:35 user nova-compute[75017]:     <feature policy='require' name='x2apic'/>
Oct 30 09:16:35 user nova-compute[75017]:     <feature policy='require' name='hypervisor'/>
Oct 30 09:16:35 user nova-compute[75017]:   </cpu>
Oct 30 09:16:35 user nova-compute[75017]:   <clock offset='utc'>
Oct 30 09:16:35 user nova-compute[75017]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 09:16:35 user nova-compute[75017]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 09:16:35 user nova-compute[75017]:     <timer name='hpet' present='no'/>
Oct 30 09:16:35 user nova-compute[75017]:   </clock>
Oct 30 09:16:35 user nova-compute[75017]:   <on_poweroff>destroy</on_poweroff>
Oct 30 09:16:35 user nova-compute[75017]:   <on_reboot>restart</on_reboot>
Oct 30 09:16:35 user nova-compute[75017]:   <on_crash>destroy</on_crash>
Oct 30 09:16:35 user nova-compute[75017]:   <devices>
Oct 30 09:16:35 user nova-compute[75017]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 09:16:35 user nova-compute[75017]:     <disk type='file' device='disk'>
Oct 30 09:16:35 user nova-compute[75017]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 09:16:35 user nova-compute[75017]:       <source file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk' index='2'/>
Oct 30 09:16:35 user nova-compute[75017]:       <backingStore type='file' index='3'>
Oct 30 09:16:35 user nova-compute[75017]:         <format type='raw'/>
Oct 30 09:16:35 user nova-compute[75017]:         <source file='/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1'/>
Oct 30 09:16:35 user nova-compute[75017]:         <backingStore/>
Oct 30 09:16:35 user nova-compute[75017]:       </backingStore>
Oct 30 09:16:35 user nova-compute[75017]:       <target dev='vda' bus='virtio'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='virtio-disk0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </disk>
Oct 30 09:16:35 user nova-compute[75017]:     <disk type='file' device='cdrom'>
Oct 30 09:16:35 user nova-compute[75017]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 09:16:35 user nova-compute[75017]:       <source file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/disk.config' index='1'/>
Oct 30 09:16:35 user nova-compute[75017]:       <backingStore/>
Oct 30 09:16:35 user nova-compute[75017]:       <target dev='hda' bus='ide'/>
Oct 30 09:16:35 user nova-compute[75017]:       <readonly/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='ide0-0-0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </disk>
Oct 30 09:16:35 user nova-compute[75017]:     <controller type='usb' index='0' model='none'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='usb'/>
Oct 30 09:16:35 user nova-compute[75017]:     </controller>
Oct 30 09:16:35 user nova-compute[75017]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='pci.0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </controller>
Oct 30 09:16:35 user nova-compute[75017]:     <controller type='ide' index='0'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='ide'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 09:16:35 user nova-compute[75017]:     </controller>
Oct 30 09:16:35 user nova-compute[75017]:     <interface type='ethernet'>
Oct 30 09:16:35 user nova-compute[75017]:       <mac address='fa:16:3e:3a:5d:f7'/>
Oct 30 09:16:35 user nova-compute[75017]:       <target dev='tap840e6749-42'/>
Oct 30 09:16:35 user nova-compute[75017]:       <model type='virtio'/>
Oct 30 09:16:35 user nova-compute[75017]:       <mtu size='1442'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='net0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </interface>
Oct 30 09:16:35 user nova-compute[75017]:     <serial type='pty'>
Oct 30 09:16:35 user nova-compute[75017]:       <source path='/dev/pts/5'/>
Oct 30 09:16:35 user nova-compute[75017]:       <log file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log' append='off'/>
Oct 30 09:16:35 user nova-compute[75017]:       <target type='isa-serial' port='0'>
Oct 30 09:16:35 user nova-compute[75017]:         <model name='isa-serial'/>
Oct 30 09:16:35 user nova-compute[75017]:       </target>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='serial0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </serial>
Oct 30 09:16:35 user nova-compute[75017]:     <console type='pty' tty='/dev/pts/5'>
Oct 30 09:16:35 user nova-compute[75017]:       <source path='/dev/pts/5'/>
Oct 30 09:16:35 user nova-compute[75017]:       <log file='/opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974/console.log' append='off'/>
Oct 30 09:16:35 user nova-compute[75017]:       <target type='serial' port='0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='serial0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </console>
Oct 30 09:16:35 user nova-compute[75017]:     <input type='mouse' bus='ps2'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='input0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </input>
Oct 30 09:16:35 user nova-compute[75017]:     <input type='keyboard' bus='ps2'>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='input1'/>
Oct 30 09:16:35 user nova-compute[75017]:     </input>
Oct 30 09:16:35 user nova-compute[75017]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 30 09:16:35 user nova-compute[75017]:       <listen type='address' address='0.0.0.0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </graphics>
Oct 30 09:16:35 user nova-compute[75017]:     <audio id='1' type='none'/>
Oct 30 09:16:35 user nova-compute[75017]:     <video>
Oct 30 09:16:35 user nova-compute[75017]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='video0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </video>
Oct 30 09:16:35 user nova-compute[75017]:     <memballoon model='virtio'>
Oct 30 09:16:35 user nova-compute[75017]:       <stats period='10'/>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='balloon0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </memballoon>
Oct 30 09:16:35 user nova-compute[75017]:     <rng model='virtio'>
Oct 30 09:16:35 user nova-compute[75017]:       <backend model='random'>/dev/urandom</backend>
Oct 30 09:16:35 user nova-compute[75017]:       <alias name='rng0'/>
Oct 30 09:16:35 user nova-compute[75017]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 09:16:35 user nova-compute[75017]:     </rng>
Oct 30 09:16:35 user nova-compute[75017]:   </devices>
Oct 30 09:16:35 user nova-compute[75017]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 09:16:35 user nova-compute[75017]:     <label>libvirt-17969235-fc8b-4b25-995b-fdce8b496974</label>
Oct 30 09:16:35 user nova-compute[75017]:     <imagelabel>libvirt-17969235-fc8b-4b25-995b-fdce8b496974</imagelabel>
Oct 30 09:16:35 user nova-compute[75017]:   </seclabel>
Oct 30 09:16:35 user nova-compute[75017]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 09:16:35 user nova-compute[75017]:     <label>+64055:+108</label>
Oct 30 09:16:35 user nova-compute[75017]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 09:16:35 user nova-compute[75017]:   </seclabel>
Oct 30 09:16:35 user nova-compute[75017]: </domain>
Oct 30 09:16:35 user nova-compute[75017]:  {{(pid=75017) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 09:16:35 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Detaching interface fa:16:3e:8c:b2:26 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa09feea2-ad' not found.
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-57449668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-57449668',id=7,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISm4h9XE1KNjZ2BtaUqmuhfL1YRvfcyLbox2ZePi/EII8ogZ6S4AfZo+/2Z52igxxz2fW/Rx2pXwsmh/8mnYbXpfRpgYHTdJLGwxN4G2z5fHYm02Wr1qLrrUa0GrO3NaQ==',key_name='tempest-keypair-1815186852',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cbfa2cb0b7e442eb6a91f94df21dbe0',ramdisk_id='',reservation_id='r-zhoyj2oj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2138896194',owner_user_name='tempest-TaggedAttachmentsTest-2138896194-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72543d1c58b7444aa36e252b59f33625',uuid=17969235-fc8b-4b25-995b-fdce8b496974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] Converting VIF {"id": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "address": "fa:16:3e:8c:b2:26", "network": {"id": "7fe327cf-ae5e-4cdf-9e65-59931f870188", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-722177916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09feea2-ad", "ovs_interfaceid": "a09feea2-ad99-45ce-a6f3-4286f4f7e063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG os_vif [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa09feea2-ad, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:16:35 user nova-compute[75017]: INFO os_vif [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:26,bridge_name='br-int',has_traffic_filtering=True,id=a09feea2-ad99-45ce-a6f3-4286f4f7e063,network=Network(7fe327cf-ae5e-4cdf-9e65-59931f870188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09feea2-ad')
Oct 30 09:16:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [req-985da0f5-4990-47e5-a77e-333ceb4b368b req-85cec923-a319-470d-85bd-5f9eeeefbac4 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:35 user nova-compute[75017]:   <nova:package version="0.0.0"/>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:name>tempest-device-tagging-server-57449668</nova:name>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:creationTime>2023-10-30 09:16:35</nova:creationTime>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:flavor name="m1.tiny">
Oct 30 09:16:35 user nova-compute[75017]:     <nova:memory>512</nova:memory>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:disk>1</nova:disk>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:swap>0</nova:swap>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:35 user nova-compute[75017]:   </nova:flavor>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:owner>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:user uuid="72543d1c58b7444aa36e252b59f33625">tempest-TaggedAttachmentsTest-2138896194-project-member</nova:user>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:project uuid="2cbfa2cb0b7e442eb6a91f94df21dbe0">tempest-TaggedAttachmentsTest-2138896194</nova:project>
Oct 30 09:16:35 user nova-compute[75017]:   </nova:owner>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:35 user nova-compute[75017]:   <nova:ports>
Oct 30 09:16:35 user nova-compute[75017]:     <nova:port uuid="840e6749-42d0-4bb0-9787-a348ca450fe7">
Oct 30 09:16:35 user nova-compute[75017]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:16:35 user nova-compute[75017]:     </nova:port>
Oct 30 09:16:35 user nova-compute[75017]:   </nova:ports>
Oct 30 09:16:35 user nova-compute[75017]: </nova:instance>
Oct 30 09:16:35 user nova-compute[75017]:  {{(pid=75017) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 30 09:16:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updating instance_info_cache with network_info: [{"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Releasing lock "refresh_cache-17969235-fc8b-4b25-995b-fdce8b496974" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2b80d5b-6aab-4539-8f96-df921e0d6e8e tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "interface-17969235-fc8b-4b25-995b-fdce8b496974-a09feea2-ad99-45ce-a6f3-4286f4f7e063" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.534s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "301352c4-d76d-4564-af67-0cafdc6c893b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "301352c4-d76d-4564-af67-0cafdc6c893b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:16:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:16:36 user nova-compute[75017]: INFO nova.compute.claims [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Claim successful on node user
Oct 30 09:16:37 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:16:37 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:16:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG nova.policy [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70705b579acb43ef8420b6fa57c64e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6be03e11b42249f25e6a80223f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:16:37 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Creating image(s)
Oct 30 09:16:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "/opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "/opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "/opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.220s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Successfully created port: 097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk 1073741824" returned: 0 in 0.104s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Cannot resize image /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Ensure instance console log exists: /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Successfully updated port: 097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "refresh_cache-301352c4-d76d-4564-af67-0cafdc6c893b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquired lock "refresh_cache-301352c4-d76d-4564-af67-0cafdc6c893b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-15ff54a3-26ac-40a0-a8f7-ca1a4c5727f8 req-bd993d1d-eddc-4c37-88a5-38f8ba80d093 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received event network-changed-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-15ff54a3-26ac-40a0-a8f7-ca1a4c5727f8 req-bd993d1d-eddc-4c37-88a5-38f8ba80d093 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Refreshing instance network info cache due to event network-changed-097ac0ad-bda4-4b58-a21e-133fe77f76ca. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-15ff54a3-26ac-40a0-a8f7-ca1a4c5727f8 req-bd993d1d-eddc-4c37-88a5-38f8ba80d093 service nova] Acquiring lock "refresh_cache-301352c4-d76d-4564-af67-0cafdc6c893b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:16:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Updating instance_info_cache with network_info: [{"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Releasing lock "refresh_cache-301352c4-d76d-4564-af67-0cafdc6c893b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Instance network_info: |[{"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-15ff54a3-26ac-40a0-a8f7-ca1a4c5727f8 req-bd993d1d-eddc-4c37-88a5-38f8ba80d093 service nova] Acquired lock "refresh_cache-301352c4-d76d-4564-af67-0cafdc6c893b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.network.neutron [req-15ff54a3-26ac-40a0-a8f7-ca1a4c5727f8 req-bd993d1d-eddc-4c37-88a5-38f8ba80d093 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Refreshing network info cache for port 097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Start _get_guest_xml network_info=[{"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:16:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2120330198',display_name='tempest-VolumesAdminNegativeTest-server-2120330198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2120330198',id=16,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70c6be03e11b42249f25e6a80223f16f',ramdisk_id='',reservation_id='r-4pe5aqn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-790420406',owner_user_name='tempest-VolumesAdminNegativeTest-790420406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:37Z,user_data=None,user_id='70705b579acb43ef8420b6fa57c64e12',uuid=301352c4-d76d-4564-af67-0cafdc6c893b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converting VIF {"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=097ac0ad-bda4-4b58-a21e-133fe77f76ca,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097ac0ad-bd') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lazy-loading 'pci_devices' on Instance uuid 301352c4-d76d-4564-af67-0cafdc6c893b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:16:39 user nova-compute[75017]:   <uuid>301352c4-d76d-4564-af67-0cafdc6c893b</uuid>
Oct 30 09:16:39 user nova-compute[75017]:   <name>instance-00000010</name>
Oct 30 09:16:39 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:16:39 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:16:39 user nova-compute[75017]:   <metadata>
Oct 30 09:16:39 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:16:39 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:16:39 user nova-compute[75017]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2120330198</nova:name>
Oct 30 09:16:39 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:16:39</nova:creationTime>
Oct 30 09:16:39 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:16:39 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:16:39 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:16:39 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:16:39 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:16:39 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:16:39 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:16:39 user nova-compute[75017]:       <nova:owner>
Oct 30 09:16:39 user nova-compute[75017]:         <nova:user uuid="70705b579acb43ef8420b6fa57c64e12">tempest-VolumesAdminNegativeTest-790420406-project-member</nova:user>
Oct 30 09:16:39 user nova-compute[75017]:         <nova:project uuid="70c6be03e11b42249f25e6a80223f16f">tempest-VolumesAdminNegativeTest-790420406</nova:project>
Oct 30 09:16:39 user nova-compute[75017]:       </nova:owner>
Oct 30 09:16:39 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:16:39 user nova-compute[75017]:       <nova:ports>
Oct 30 09:16:39 user nova-compute[75017]:         <nova:port uuid="097ac0ad-bda4-4b58-a21e-133fe77f76ca">
Oct 30 09:16:39 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:16:39 user nova-compute[75017]:         </nova:port>
Oct 30 09:16:39 user nova-compute[75017]:       </nova:ports>
Oct 30 09:16:39 user nova-compute[75017]:     </nova:instance>
Oct 30 09:16:39 user nova-compute[75017]:   </metadata>
Oct 30 09:16:39 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:16:39 user nova-compute[75017]:     <system>
Oct 30 09:16:39 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:16:39 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:16:39 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:16:39 user nova-compute[75017]:       <entry name="serial">301352c4-d76d-4564-af67-0cafdc6c893b</entry>
Oct 30 09:16:39 user nova-compute[75017]:       <entry name="uuid">301352c4-d76d-4564-af67-0cafdc6c893b</entry>
Oct 30 09:16:39 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:16:39 user nova-compute[75017]:     </system>
Oct 30 09:16:39 user nova-compute[75017]:   </sysinfo>
Oct 30 09:16:39 user nova-compute[75017]:   <os>
Oct 30 09:16:39 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:16:39 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:16:39 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:16:39 user nova-compute[75017]:   </os>
Oct 30 09:16:39 user nova-compute[75017]:   <features>
Oct 30 09:16:39 user nova-compute[75017]:     <acpi/>
Oct 30 09:16:39 user nova-compute[75017]:     <apic/>
Oct 30 09:16:39 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:16:39 user nova-compute[75017]:   </features>
Oct 30 09:16:39 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:16:39 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:16:39 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:16:39 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:16:39 user nova-compute[75017]:   </clock>
Oct 30 09:16:39 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:16:39 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:16:39 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:16:39 user nova-compute[75017]:   </cpu>
Oct 30 09:16:39 user nova-compute[75017]:   <devices>
Oct 30 09:16:39 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:16:39 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:16:39 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk"/>
Oct 30 09:16:39 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:16:39 user nova-compute[75017]:     </disk>
Oct 30 09:16:39 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:16:39 user nova-compute[75017]:       <mac address="fa:16:3e:61:d6:d5"/>
Oct 30 09:16:39 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:16:39 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:16:39 user nova-compute[75017]:       <target dev="tap097ac0ad-bd"/>
Oct 30 09:16:39 user nova-compute[75017]:     </interface>
Oct 30 09:16:39 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:16:39 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/console.log" append="off"/>
Oct 30 09:16:39 user nova-compute[75017]:     </serial>
Oct 30 09:16:39 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:16:39 user nova-compute[75017]:     <video>
Oct 30 09:16:39 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:16:39 user nova-compute[75017]:     </video>
Oct 30 09:16:39 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:16:39 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:16:39 user nova-compute[75017]:     </rng>
Oct 30 09:16:39 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:16:39 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:16:39 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:16:39 user nova-compute[75017]:     </memballoon>
Oct 30 09:16:39 user nova-compute[75017]:   </devices>
Oct 30 09:16:39 user nova-compute[75017]: </domain>
Oct 30 09:16:39 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2120330198',display_name='tempest-VolumesAdminNegativeTest-server-2120330198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2120330198',id=16,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70c6be03e11b42249f25e6a80223f16f',ramdisk_id='',reservation_id='r-4pe5aqn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-790420406',owner_user_name='tempest-VolumesAdminNegativeTest-790420406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:37Z,user_data=None,user_id='70705b579acb43ef8420b6fa57c64e12',uuid=301352c4-d76d-4564-af67-0cafdc6c893b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converting VIF {"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=097ac0ad-bda4-4b58-a21e-133fe77f76ca,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097ac0ad-bd') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG os_vif [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=097ac0ad-bda4-4b58-a21e-133fe77f76ca,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097ac0ad-bd') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1e9cf39-5627-5e1d-ab09-a30a119210c1', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap097ac0ad-bd, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap097ac0ad-bd, col_values=(('qos', UUID('08fd7ec3-c1be-4725-9336-6366d03684e9')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap097ac0ad-bd, col_values=(('external_ids', {'iface-id': '097ac0ad-bda4-4b58-a21e-133fe77f76ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:d6:d5', 'vm-uuid': '301352c4-d76d-4564-af67-0cafdc6c893b'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:39 user nova-compute[75017]: INFO os_vif [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=097ac0ad-bda4-4b58-a21e-133fe77f76ca,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097ac0ad-bd')
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] No VIF found with MAC fa:16:3e:61:d6:d5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.network.neutron [req-15ff54a3-26ac-40a0-a8f7-ca1a4c5727f8 req-bd993d1d-eddc-4c37-88a5-38f8ba80d093 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Updated VIF entry in instance network info cache for port 097ac0ad-bda4-4b58-a21e-133fe77f76ca. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG nova.network.neutron [req-15ff54a3-26ac-40a0-a8f7-ca1a4c5727f8 req-bd993d1d-eddc-4c37-88a5-38f8ba80d093 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Updating instance_info_cache with network_info: [{"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-15ff54a3-26ac-40a0-a8f7-ca1a4c5727f8 req-bd993d1d-eddc-4c37-88a5-38f8ba80d093 service nova] Releasing lock "refresh_cache-301352c4-d76d-4564-af67-0cafdc6c893b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:16:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-292e0630-59bd-4a8e-9e3e-4c64064e17c0 req-9be58fc6-016b-43cc-b4e9-8ae59528f3f9 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received event network-vif-plugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-292e0630-59bd-4a8e-9e3e-4c64064e17c0 req-9be58fc6-016b-43cc-b4e9-8ae59528f3f9 service nova] Acquiring lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-292e0630-59bd-4a8e-9e3e-4c64064e17c0 req-9be58fc6-016b-43cc-b4e9-8ae59528f3f9 service nova] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-292e0630-59bd-4a8e-9e3e-4c64064e17c0 req-9be58fc6-016b-43cc-b4e9-8ae59528f3f9 service nova] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-292e0630-59bd-4a8e-9e3e-4c64064e17c0 req-9be58fc6-016b-43cc-b4e9-8ae59528f3f9 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] No waiting events found dispatching network-vif-plugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:41 user nova-compute[75017]: WARNING nova.compute.manager [req-292e0630-59bd-4a8e-9e3e-4c64064e17c0 req-9be58fc6-016b-43cc-b4e9-8ae59528f3f9 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received unexpected event network-vif-plugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca for instance with vm_state building and task_state spawning.
Oct 30 09:16:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:16:43 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Instance spawned successfully.
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-7dc3758a-7205-4529-b07b-73a190442234 req-e84493fc-b7af-4c97-9f2a-d98dcb04ea1d service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received event network-vif-plugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7dc3758a-7205-4529-b07b-73a190442234 req-e84493fc-b7af-4c97-9f2a-d98dcb04ea1d service nova] Acquiring lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7dc3758a-7205-4529-b07b-73a190442234 req-e84493fc-b7af-4c97-9f2a-d98dcb04ea1d service nova] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7dc3758a-7205-4529-b07b-73a190442234 req-e84493fc-b7af-4c97-9f2a-d98dcb04ea1d service nova] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-7dc3758a-7205-4529-b07b-73a190442234 req-e84493fc-b7af-4c97-9f2a-d98dcb04ea1d service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] No waiting events found dispatching network-vif-plugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:43 user nova-compute[75017]: WARNING nova.compute.manager [req-7dc3758a-7205-4529-b07b-73a190442234 req-e84493fc-b7af-4c97-9f2a-d98dcb04ea1d service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received unexpected event network-vif-plugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca for instance with vm_state building and task_state spawning.
Oct 30 09:16:43 user nova-compute[75017]: INFO nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Took 5.61 seconds to spawn the instance on the hypervisor.
Oct 30 09:16:43 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:16:43 user nova-compute[75017]: INFO nova.compute.manager [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Took 6.47 seconds to build instance.
Oct 30 09:16:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ebd018f5-1ba4-41e4-b656-9e6bff0f247c tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "301352c4-d76d-4564-af67-0cafdc6c893b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.590s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:49 user nova-compute[75017]: INFO nova.compute.manager [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Terminating instance
Oct 30 09:16:49 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-29395b8c-b428-40fd-ad61-593384fb7f39 req-86f371ed-6e32-42c5-a176-cb35d68da386 service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received event network-vif-unplugged-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-29395b8c-b428-40fd-ad61-593384fb7f39 req-86f371ed-6e32-42c5-a176-cb35d68da386 service nova] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-29395b8c-b428-40fd-ad61-593384fb7f39 req-86f371ed-6e32-42c5-a176-cb35d68da386 service nova] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-29395b8c-b428-40fd-ad61-593384fb7f39 req-86f371ed-6e32-42c5-a176-cb35d68da386 service nova] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-29395b8c-b428-40fd-ad61-593384fb7f39 req-86f371ed-6e32-42c5-a176-cb35d68da386 service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] No waiting events found dispatching network-vif-unplugged-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-29395b8c-b428-40fd-ad61-593384fb7f39 req-86f371ed-6e32-42c5-a176-cb35d68da386 service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received event network-vif-unplugged-206f4965-cf18-4bb3-a500-f5190b3ef833 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:16:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Instance destroyed successfully.
Oct 30 09:16:50 user nova-compute[75017]: DEBUG nova.objects.instance [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lazy-loading 'resources' on Instance uuid 32e25927-79c3-490f-b53a-03d4a6299e42 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-980255719',display_name='tempest-VolumesAssistedSnapshotsTest-server-980255719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-980255719',id=8,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiniJ6k7LE2AC+XrNeRBK1F5zsv44UUAxUVO4FOXGxcJjFnrLdNzviWVrW1CbwY8iMnqocbYt3O+pAx47+KUnU0u4aQQnMsdOQ9WBbmwx0iLvrFTeZOfcktyEXH+QiYmg==',key_name='tempest-keypair-625456945',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:13:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0293b9d9e7684474808321a8327d8338',ramdisk_id='',reservation_id='r-0xm1wm8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-221021361',owner_user_name='tempest-VolumesAssistedSnapshotsTest-221021361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23cd27d764e549da8d31f2061e0be75d',uuid=32e25927-79c3-490f-b53a-03d4a6299e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Converting VIF {"id": "206f4965-cf18-4bb3-a500-f5190b3ef833", "address": "fa:16:3e:82:b1:c5", "network": {"id": "340760f9-8f2b-4382-a61d-882225c35454", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795428486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0293b9d9e7684474808321a8327d8338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206f4965-cf", "ovs_interfaceid": "206f4965-cf18-4bb3-a500-f5190b3ef833", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=206f4965-cf18-4bb3-a500-f5190b3ef833,network=Network(340760f9-8f2b-4382-a61d-882225c35454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206f4965-cf') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG os_vif [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=206f4965-cf18-4bb3-a500-f5190b3ef833,network=Network(340760f9-8f2b-4382-a61d-882225c35454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206f4965-cf') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap206f4965-cf, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=141b940d-25ae-4ea5-b92a-e6838840cafb) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:16:50 user nova-compute[75017]: INFO os_vif [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=206f4965-cf18-4bb3-a500-f5190b3ef833,network=Network(340760f9-8f2b-4382-a61d-882225c35454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206f4965-cf')
Oct 30 09:16:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Deleting instance files /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42_del
Oct 30 09:16:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Deletion of /opt/stack/data/nova/instances/32e25927-79c3-490f-b53a-03d4a6299e42_del complete
Oct 30 09:16:50 user nova-compute[75017]: INFO nova.compute.manager [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 30 09:16:50 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:16:50 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:51 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Took 0.93 seconds to deallocate network for instance.
Oct 30 09:16:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-b8af1845-f2fa-420e-b433-3a2c8cf71afc req-fc78ea37-9aa3-4d3a-a682-5cd3c593f15a service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received event network-vif-deleted-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:51 user nova-compute[75017]: INFO nova.compute.manager [req-b8af1845-f2fa-420e-b433-3a2c8cf71afc req-fc78ea37-9aa3-4d3a-a682-5cd3c593f15a service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Neutron deleted interface 206f4965-cf18-4bb3-a500-f5190b3ef833; detaching it from the instance and deleting it from the info cache
Oct 30 09:16:51 user nova-compute[75017]: DEBUG nova.network.neutron [req-b8af1845-f2fa-420e-b433-3a2c8cf71afc req-fc78ea37-9aa3-4d3a-a682-5cd3c593f15a service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-b8af1845-f2fa-420e-b433-3a2c8cf71afc req-fc78ea37-9aa3-4d3a-a682-5cd3c593f15a service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Detach interface failed, port_id=206f4965-cf18-4bb3-a500-f5190b3ef833, reason: Instance 32e25927-79c3-490f-b53a-03d4a6299e42 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-219677ea-1cc7-4fa9-8fa5-e41bd6b20492 req-d1693c6c-0d57-48d7-90e3-689e39e46b71 service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received event network-vif-plugged-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-219677ea-1cc7-4fa9-8fa5-e41bd6b20492 req-d1693c6c-0d57-48d7-90e3-689e39e46b71 service nova] Acquiring lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-219677ea-1cc7-4fa9-8fa5-e41bd6b20492 req-d1693c6c-0d57-48d7-90e3-689e39e46b71 service nova] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-219677ea-1cc7-4fa9-8fa5-e41bd6b20492 req-d1693c6c-0d57-48d7-90e3-689e39e46b71 service nova] Lock "32e25927-79c3-490f-b53a-03d4a6299e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-219677ea-1cc7-4fa9-8fa5-e41bd6b20492 req-d1693c6c-0d57-48d7-90e3-689e39e46b71 service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] No waiting events found dispatching network-vif-plugged-206f4965-cf18-4bb3-a500-f5190b3ef833 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:16:51 user nova-compute[75017]: WARNING nova.compute.manager [req-219677ea-1cc7-4fa9-8fa5-e41bd6b20492 req-d1693c6c-0d57-48d7-90e3-689e39e46b71 service nova] [instance: 32e25927-79c3-490f-b53a-03d4a6299e42] Received unexpected event network-vif-plugged-206f4965-cf18-4bb3-a500-f5190b3ef833 for instance with vm_state deleted and task_state None.
Oct 30 09:16:51 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:16:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:51 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Deleted allocations for instance 32e25927-79c3-490f-b53a-03d4a6299e42
Oct 30 09:16:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c3af2e4-dd6b-4e49-b99c-63bea764e3eb tempest-VolumesAssistedSnapshotsTest-221021361 tempest-VolumesAssistedSnapshotsTest-221021361-project-member] Lock "32e25927-79c3-490f-b53a-03d4a6299e42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.895s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:16:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:16:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:17:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Creating image(s)
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Ensure instance console log exists: /opt/stack/data/nova/instances/5a294811-e03d-4034-871d-db6ba2ad721d/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Start _get_guest_xml network_info=[{"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoyQnSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a294811-e03d-4034-871d-db6ba2ad721d', 'attached_at': '', 'detached_at': '', 'volume_id': '3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'serial': '3a9871b3-cec4-447d-89c0-aa4d20fa3244'}, 'disk_bus': 'virtio', 'attachment_id': 'e8cae09f-92d3-425e-a828-bb809e03cc91', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:17:01 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 09:17:01 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a294811-e03d-4034-871d-db6ba2ad721d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoyQnSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:17:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:17:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:17:01 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ad473c-8c38-469d-aee4-eedfb0655fbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:17:01 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd15c0b8-4b4a-4d48-86fb-ef1bd0358c24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244] added
Oct 30 09:17:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[784ef7aa-4473-42b5-a86d-4e2f4d322d18]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[159d9acd-47bc-4a3a-b7ce-56e03a5761a0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAoyQnSZ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAoyQnSZ" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea9aeab-ec5f-4671-b1b4-eead0f0f77fc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FAoyQnSZ'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc4f9ef-63fa-4c10-9ff1-21ee0151ad98]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[897c5307-b684-4902-aa48-17c2b432033a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:17:01 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:17:01 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:01 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:01 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:17:01 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:17:01 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:01 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:01 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:17:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98f9a55-e516-482d-b592-58c7d2828c89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260]
Oct 30 09:17:02 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260] successful.
Oct 30 09:17:02 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6526bafd-b23b-4517-8101-54c766619957]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e89013-90d2-4690-98ac-26cfe7ffd852]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:02 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:02 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:02 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eae539-2e44-482d-8c62-9234e3c53844]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:02 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoyQnSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26333346235353632', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333346235353632', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1298966713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336386316',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK41I5D09IEItrwBGv57T/9QpZ4xvfrikmugxYqYCeOgq36dju7nfyqi8IgYaIAFEzcXXx+7C1Q8g3cHSKYsfkHntXkvMk131KHuB14YNxNDJqfZXdzIIjjyJdTTefyNRA==',key_name='tempest-keypair-1967695828',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='734c9139fffd4605a81e382a6b54a0e6',ramdisk_id='',reservation_id='r-takylgq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1641318212',owner_user_name='tempest-ServerActionsV293TestJSON-1641318212-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f08150a4aa4eff90af699ccc61d4e5',uuid=5a294811-e03d-4034-871d-db6ba2ad721d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converting VIF {"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:17:03 user nova-compute[75017]:   <uuid>5a294811-e03d-4034-871d-db6ba2ad721d</uuid>
Oct 30 09:17:03 user nova-compute[75017]:   <name>instance-00000009</name>
Oct 30 09:17:03 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:17:03 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:17:03 user nova-compute[75017]:   <metadata>
Oct 30 09:17:03 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:17:03 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:17:03 user nova-compute[75017]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1298966713</nova:name>
Oct 30 09:17:03 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:17:01</nova:creationTime>
Oct 30 09:17:03 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:17:03 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:17:03 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:17:03 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:17:03 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:17:03 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:17:03 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:17:03 user nova-compute[75017]:       <nova:owner>
Oct 30 09:17:03 user nova-compute[75017]:         <nova:user uuid="85f08150a4aa4eff90af699ccc61d4e5">tempest-ServerActionsV293TestJSON-1641318212-project-member</nova:user>
Oct 30 09:17:03 user nova-compute[75017]:         <nova:project uuid="734c9139fffd4605a81e382a6b54a0e6">tempest-ServerActionsV293TestJSON-1641318212</nova:project>
Oct 30 09:17:03 user nova-compute[75017]:       </nova:owner>
Oct 30 09:17:03 user nova-compute[75017]:       <nova:ports>
Oct 30 09:17:03 user nova-compute[75017]:         <nova:port uuid="0710ebd4-b142-4fec-b28f-338eced9e4c7">
Oct 30 09:17:03 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:17:03 user nova-compute[75017]:         </nova:port>
Oct 30 09:17:03 user nova-compute[75017]:       </nova:ports>
Oct 30 09:17:03 user nova-compute[75017]:     </nova:instance>
Oct 30 09:17:03 user nova-compute[75017]:   </metadata>
Oct 30 09:17:03 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:17:03 user nova-compute[75017]:     <system>
Oct 30 09:17:03 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:17:03 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:17:03 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:17:03 user nova-compute[75017]:       <entry name="serial">5a294811-e03d-4034-871d-db6ba2ad721d</entry>
Oct 30 09:17:03 user nova-compute[75017]:       <entry name="uuid">5a294811-e03d-4034-871d-db6ba2ad721d</entry>
Oct 30 09:17:03 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:17:03 user nova-compute[75017]:     </system>
Oct 30 09:17:03 user nova-compute[75017]:   </sysinfo>
Oct 30 09:17:03 user nova-compute[75017]:   <os>
Oct 30 09:17:03 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:17:03 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:17:03 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:17:03 user nova-compute[75017]:   </os>
Oct 30 09:17:03 user nova-compute[75017]:   <features>
Oct 30 09:17:03 user nova-compute[75017]:     <acpi/>
Oct 30 09:17:03 user nova-compute[75017]:     <apic/>
Oct 30 09:17:03 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:17:03 user nova-compute[75017]:   </features>
Oct 30 09:17:03 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:17:03 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:17:03 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:17:03 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:17:03 user nova-compute[75017]:   </clock>
Oct 30 09:17:03 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:17:03 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:17:03 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:17:03 user nova-compute[75017]:   </cpu>
Oct 30 09:17:03 user nova-compute[75017]:   <devices>
Oct 30 09:17:03 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:17:03 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:17:03 user nova-compute[75017]:       <source dev="/dev/sdc"/>
Oct 30 09:17:03 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:17:03 user nova-compute[75017]:       <serial>3a9871b3-cec4-447d-89c0-aa4d20fa3244</serial>
Oct 30 09:17:03 user nova-compute[75017]:     </disk>
Oct 30 09:17:03 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:17:03 user nova-compute[75017]:       <mac address="fa:16:3e:be:0d:f7"/>
Oct 30 09:17:03 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:17:03 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:17:03 user nova-compute[75017]:       <target dev="tap0710ebd4-b1"/>
Oct 30 09:17:03 user nova-compute[75017]:     </interface>
Oct 30 09:17:03 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:17:03 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/5a294811-e03d-4034-871d-db6ba2ad721d/console.log" append="off"/>
Oct 30 09:17:03 user nova-compute[75017]:     </serial>
Oct 30 09:17:03 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:17:03 user nova-compute[75017]:     <video>
Oct 30 09:17:03 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:17:03 user nova-compute[75017]:     </video>
Oct 30 09:17:03 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:17:03 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:17:03 user nova-compute[75017]:     </rng>
Oct 30 09:17:03 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:17:03 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:17:03 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:17:03 user nova-compute[75017]:     </memballoon>
Oct 30 09:17:03 user nova-compute[75017]:   </devices>
Oct 30 09:17:03 user nova-compute[75017]: </domain>
Oct 30 09:17:03 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1298966713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336386316',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK41I5D09IEItrwBGv57T/9QpZ4xvfrikmugxYqYCeOgq36dju7nfyqi8IgYaIAFEzcXXx+7C1Q8g3cHSKYsfkHntXkvMk131KHuB14YNxNDJqfZXdzIIjjyJdTTefyNRA==',key_name='tempest-keypair-1967695828',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='734c9139fffd4605a81e382a6b54a0e6',ramdisk_id='',reservation_id='r-takylgq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1641318212',owner_user_name='tempest-ServerActionsV293TestJSON-1641318212-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f08150a4aa4eff90af699ccc61d4e5',uuid=5a294811-e03d-4034-871d-db6ba2ad721d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converting VIF {"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG os_vif [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82d0878e-ea0d-5e93-8a2b-fbe762d354e0', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0710ebd4-b1, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0710ebd4-b1, col_values=(('qos', UUID('a3fbf245-6361-49ed-9bca-8f7b2040ea59')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0710ebd4-b1, col_values=(('external_ids', {'iface-id': '0710ebd4-b142-4fec-b28f-338eced9e4c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:0d:f7', 'vm-uuid': '5a294811-e03d-4034-871d-db6ba2ad721d'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:03 user nova-compute[75017]: INFO os_vif [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1')
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:17:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] No VIF found with MAC fa:16:3e:be:0d:f7, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:04 user nova-compute[75017]: INFO nova.compute.manager [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Terminating instance
Oct 30 09:17:04 user nova-compute[75017]: DEBUG nova.compute.manager [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-322d8366-7998-456b-a350-4f79a5bf7fff req-a395dac0-2ad3-4dcb-a046-c021903eaf66 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-unplugged-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-322d8366-7998-456b-a350-4f79a5bf7fff req-a395dac0-2ad3-4dcb-a046-c021903eaf66 service nova] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-322d8366-7998-456b-a350-4f79a5bf7fff req-a395dac0-2ad3-4dcb-a046-c021903eaf66 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-322d8366-7998-456b-a350-4f79a5bf7fff req-a395dac0-2ad3-4dcb-a046-c021903eaf66 service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-322d8366-7998-456b-a350-4f79a5bf7fff req-a395dac0-2ad3-4dcb-a046-c021903eaf66 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] No waiting events found dispatching network-vif-unplugged-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-322d8366-7998-456b-a350-4f79a5bf7fff req-a395dac0-2ad3-4dcb-a046-c021903eaf66 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-unplugged-840e6749-42d0-4bb0-9787-a348ca450fe7 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-d7cefb8e-a03b-4ce8-9e1a-fd976620a5f7 req-dcc08f1d-2366-4ac5-80bc-2901b01e6446 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d7cefb8e-a03b-4ce8-9e1a-fd976620a5f7 req-dcc08f1d-2366-4ac5-80bc-2901b01e6446 service nova] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d7cefb8e-a03b-4ce8-9e1a-fd976620a5f7 req-dcc08f1d-2366-4ac5-80bc-2901b01e6446 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d7cefb8e-a03b-4ce8-9e1a-fd976620a5f7 req-dcc08f1d-2366-4ac5-80bc-2901b01e6446 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-d7cefb8e-a03b-4ce8-9e1a-fd976620a5f7 req-dcc08f1d-2366-4ac5-80bc-2901b01e6446 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] No waiting events found dispatching network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:04 user nova-compute[75017]: WARNING nova.compute.manager [req-d7cefb8e-a03b-4ce8-9e1a-fd976620a5f7 req-dcc08f1d-2366-4ac5-80bc-2901b01e6446 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received unexpected event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 for instance with vm_state active and task_state rebuild_spawning.
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Instance destroyed successfully.
Oct 30 09:17:05 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lazy-loading 'resources' on Instance uuid 17969235-fc8b-4b25-995b-fdce8b496974 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-57449668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-57449668',id=7,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISm4h9XE1KNjZ2BtaUqmuhfL1YRvfcyLbox2ZePi/EII8ogZ6S4AfZo+/2Z52igxxz2fW/Rx2pXwsmh/8mnYbXpfRpgYHTdJLGwxN4G2z5fHYm02Wr1qLrrUa0GrO3NaQ==',key_name='tempest-keypair-1815186852',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cbfa2cb0b7e442eb6a91f94df21dbe0',ramdisk_id='',reservation_id='r-zhoyj2oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2138896194',owner_user_name='tempest-TaggedAttachmentsTest-2138896194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72543d1c58b7444aa36e252b59f33625',uuid=17969235-fc8b-4b25-995b-fdce8b496974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converting VIF {"id": "840e6749-42d0-4bb0-9787-a348ca450fe7", "address": "fa:16:3e:3a:5d:f7", "network": {"id": "ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-220926386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cbfa2cb0b7e442eb6a91f94df21dbe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840e6749-42", "ovs_interfaceid": "840e6749-42d0-4bb0-9787-a348ca450fe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:5d:f7,bridge_name='br-int',has_traffic_filtering=True,id=840e6749-42d0-4bb0-9787-a348ca450fe7,network=Network(ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840e6749-42') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG os_vif [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:5d:f7,bridge_name='br-int',has_traffic_filtering=True,id=840e6749-42d0-4bb0-9787-a348ca450fe7,network=Network(ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840e6749-42') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap840e6749-42, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=706ccc44-634e-4366-858f-9551821ab979) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: INFO os_vif [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:5d:f7,bridge_name='br-int',has_traffic_filtering=True,id=840e6749-42d0-4bb0-9787-a348ca450fe7,network=Network(ac895ce5-058a-4ecd-a2c7-13ff0bd9d6a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840e6749-42')
Oct 30 09:17:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Deleting instance files /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974_del
Oct 30 09:17:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Deletion of /opt/stack/data/nova/instances/17969235-fc8b-4b25-995b-fdce8b496974_del complete
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:05 user nova-compute[75017]: INFO nova.compute.manager [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 30 09:17:05 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:17:05 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:06 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Took 0.79 seconds to deallocate network for instance.
Oct 30 09:17:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-c0cccf92-ac9a-4da7-83f0-92a675e4a237 req-388f640f-60f1-4d92-ba98-4de2b8e7c726 service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-deleted-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:06 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Deleted allocations for instance 17969235-fc8b-4b25-995b-fdce8b496974
Oct 30 09:17:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-475c431c-e72d-4ef6-ab18-e1a43c8643af req-655ca83f-9f93-49cf-be93-a10d186aee1e service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-475c431c-e72d-4ef6-ab18-e1a43c8643af req-655ca83f-9f93-49cf-be93-a10d186aee1e service nova] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-475c431c-e72d-4ef6-ab18-e1a43c8643af req-655ca83f-9f93-49cf-be93-a10d186aee1e service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-475c431c-e72d-4ef6-ab18-e1a43c8643af req-655ca83f-9f93-49cf-be93-a10d186aee1e service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-475c431c-e72d-4ef6-ab18-e1a43c8643af req-655ca83f-9f93-49cf-be93-a10d186aee1e service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] No waiting events found dispatching network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:06 user nova-compute[75017]: WARNING nova.compute.manager [req-475c431c-e72d-4ef6-ab18-e1a43c8643af req-655ca83f-9f93-49cf-be93-a10d186aee1e service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received unexpected event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 for instance with vm_state active and task_state rebuild_spawning.
Oct 30 09:17:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d75930ca-41fb-468b-88cb-17d4fb2bc549 tempest-TaggedAttachmentsTest-2138896194 tempest-TaggedAttachmentsTest-2138896194-project-member] Lock "17969235-fc8b-4b25-995b-fdce8b496974" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.528s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-0eece3c7-c2b0-4028-a74b-16e0008ed7cb req-1c5b3cca-256d-4113-8955-9590aa05a38d service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received event network-vif-plugged-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0eece3c7-c2b0-4028-a74b-16e0008ed7cb req-1c5b3cca-256d-4113-8955-9590aa05a38d service nova] Acquiring lock "17969235-fc8b-4b25-995b-fdce8b496974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0eece3c7-c2b0-4028-a74b-16e0008ed7cb req-1c5b3cca-256d-4113-8955-9590aa05a38d service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0eece3c7-c2b0-4028-a74b-16e0008ed7cb req-1c5b3cca-256d-4113-8955-9590aa05a38d service nova] Lock "17969235-fc8b-4b25-995b-fdce8b496974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-0eece3c7-c2b0-4028-a74b-16e0008ed7cb req-1c5b3cca-256d-4113-8955-9590aa05a38d service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] No waiting events found dispatching network-vif-plugged-840e6749-42d0-4bb0-9787-a348ca450fe7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:07 user nova-compute[75017]: WARNING nova.compute.manager [req-0eece3c7-c2b0-4028-a74b-16e0008ed7cb req-1c5b3cca-256d-4113-8955-9590aa05a38d service nova] [instance: 17969235-fc8b-4b25-995b-fdce8b496974] Received unexpected event network-vif-plugged-840e6749-42d0-4bb0-9787-a348ca450fe7 for instance with vm_state deleted and task_state None.
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:17:07 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance spawned successfully.
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75017) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Oct 30 09:17:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a9b3f850-643f-4be8-983c-5ed98457ed66 tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.066s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:17:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:17:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:17:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:09 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:17:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.350s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:14 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:17:14 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:17:14 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7002MB free_disk=25.430057525634766GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:17:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d46e94f6-465d-4112-868e-acf8cea4f402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance df215875-673c-4446-afa1-3446ff63edbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5a294811-e03d-4034-871d-db6ba2ad721d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 8883aff3-715a-4c96-8969-e41986cad31b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 2d49c6bb-acd9-4101-be6a-640a513e84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 301352c4-d76d-4564-af67-0cafdc6c893b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.729s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:16 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:17:16 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:17:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:17:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:17:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:17:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: df215875-673c-4446-afa1-3446ff63edbd] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:17:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: df215875-673c-4446-afa1-3446ff63edbd] Updating instance_info_cache with network_info: [{"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-df215875-673c-4446-afa1-3446ff63edbd" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:17:17 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: df215875-673c-4446-afa1-3446ff63edbd] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:17:17 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:17:17 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:17:17 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:17:17 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:17:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-5511d955-c653-4e21-b22a-bf686676c042 req-81760d36-f42b-443e-8723-24c0432a1049 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received event network-changed-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-5511d955-c653-4e21-b22a-bf686676c042 req-81760d36-f42b-443e-8723-24c0432a1049 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Refreshing instance network info cache due to event network-changed-813347a3-6dfb-4815-90a0-b2f57f1d197d. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:17:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5511d955-c653-4e21-b22a-bf686676c042 req-81760d36-f42b-443e-8723-24c0432a1049 service nova] Acquiring lock "refresh_cache-2d49c6bb-acd9-4101-be6a-640a513e84ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:17:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5511d955-c653-4e21-b22a-bf686676c042 req-81760d36-f42b-443e-8723-24c0432a1049 service nova] Acquired lock "refresh_cache-2d49c6bb-acd9-4101-be6a-640a513e84ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:17:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-5511d955-c653-4e21-b22a-bf686676c042 req-81760d36-f42b-443e-8723-24c0432a1049 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Refreshing network info cache for port 813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "2d49c6bb-acd9-4101-be6a-640a513e84ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:20 user nova-compute[75017]: INFO nova.compute.manager [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Terminating instance
Oct 30 09:17:20 user nova-compute[75017]: DEBUG nova.compute.manager [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-5511d955-c653-4e21-b22a-bf686676c042 req-81760d36-f42b-443e-8723-24c0432a1049 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Updated VIF entry in instance network info cache for port 813347a3-6dfb-4815-90a0-b2f57f1d197d. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-5511d955-c653-4e21-b22a-bf686676c042 req-81760d36-f42b-443e-8723-24c0432a1049 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Updating instance_info_cache with network_info: [{"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5511d955-c653-4e21-b22a-bf686676c042 req-81760d36-f42b-443e-8723-24c0432a1049 service nova] Releasing lock "refresh_cache-2d49c6bb-acd9-4101-be6a-640a513e84ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Instance destroyed successfully.
Oct 30 09:17:21 user nova-compute[75017]: DEBUG nova.objects.instance [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'resources' on Instance uuid 2d49c6bb-acd9-4101-be6a-640a513e84ab {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1660846650',display_name='tempest-AttachVolumeNegativeTest-server-1660846650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1660846650',id=12,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+gyRgRDH/nZsbFh2atpHlBnAfzATjGo9nEdaKWDgjLx1kgRnlZiwuA/zoAwc7o5uxZhcT6JkUp5PAS/PCsrqTliuYcIJuilicizUg68wQco6eb0HZyVudO14XT8kEyxw==',key_name='tempest-keypair-884677086',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-c5gim7kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=2d49c6bb-acd9-4101-be6a-640a513e84ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "address": "fa:16:3e:1a:e1:3e", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813347a3-6d", "ovs_interfaceid": "813347a3-6dfb-4815-90a0-b2f57f1d197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=813347a3-6dfb-4815-90a0-b2f57f1d197d,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813347a3-6d') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG os_vif [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=813347a3-6dfb-4815-90a0-b2f57f1d197d,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813347a3-6d') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap813347a3-6d, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fca60cf3-0e7e-4db1-b8bb-3fc650abf53f) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:21 user nova-compute[75017]: INFO os_vif [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=813347a3-6dfb-4815-90a0-b2f57f1d197d,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813347a3-6d')
Oct 30 09:17:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Deleting instance files /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab_del
Oct 30 09:17:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Deletion of /opt/stack/data/nova/instances/2d49c6bb-acd9-4101-be6a-640a513e84ab_del complete
Oct 30 09:17:21 user nova-compute[75017]: INFO nova.compute.manager [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 30 09:17:21 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-17ef1559-c8f5-4726-aa58-9c13a5a3cdfb req-0b2154bb-9268-464c-a435-36de5a535fef service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received event network-vif-unplugged-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-17ef1559-c8f5-4726-aa58-9c13a5a3cdfb req-0b2154bb-9268-464c-a435-36de5a535fef service nova] Acquiring lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-17ef1559-c8f5-4726-aa58-9c13a5a3cdfb req-0b2154bb-9268-464c-a435-36de5a535fef service nova] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-17ef1559-c8f5-4726-aa58-9c13a5a3cdfb req-0b2154bb-9268-464c-a435-36de5a535fef service nova] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-17ef1559-c8f5-4726-aa58-9c13a5a3cdfb req-0b2154bb-9268-464c-a435-36de5a535fef service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] No waiting events found dispatching network-vif-unplugged-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-17ef1559-c8f5-4726-aa58-9c13a5a3cdfb req-0b2154bb-9268-464c-a435-36de5a535fef service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received event network-vif-unplugged-813347a3-6dfb-4815-90a0-b2f57f1d197d for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:17:22 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:22 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Took 1.46 seconds to deallocate network for instance.
Oct 30 09:17:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-96ca2f29-ff62-4b6c-b0f2-5ff2903d9ff1 req-f77f3de1-ef4a-46d7-8d58-25f6774dcb5e service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received event network-vif-deleted-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:23 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:17:23 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:17:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:23 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Deleted allocations for instance 2d49c6bb-acd9-4101-be6a-640a513e84ab
Oct 30 09:17:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-541af9fc-d4c9-4ae6-bc98-ffeb69665e8c tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-823b4f88-cc0c-4803-a3d1-debb833cbb46 req-92478704-1327-4e55-bf62-df5c2a6a8dc4 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received event network-vif-plugged-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-823b4f88-cc0c-4803-a3d1-debb833cbb46 req-92478704-1327-4e55-bf62-df5c2a6a8dc4 service nova] Acquiring lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-823b4f88-cc0c-4803-a3d1-debb833cbb46 req-92478704-1327-4e55-bf62-df5c2a6a8dc4 service nova] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-823b4f88-cc0c-4803-a3d1-debb833cbb46 req-92478704-1327-4e55-bf62-df5c2a6a8dc4 service nova] Lock "2d49c6bb-acd9-4101-be6a-640a513e84ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-823b4f88-cc0c-4803-a3d1-debb833cbb46 req-92478704-1327-4e55-bf62-df5c2a6a8dc4 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] No waiting events found dispatching network-vif-plugged-813347a3-6dfb-4815-90a0-b2f57f1d197d {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:23 user nova-compute[75017]: WARNING nova.compute.manager [req-823b4f88-cc0c-4803-a3d1-debb833cbb46 req-92478704-1327-4e55-bf62-df5c2a6a8dc4 service nova] [instance: 2d49c6bb-acd9-4101-be6a-640a513e84ab] Received unexpected event network-vif-plugged-813347a3-6dfb-4815-90a0-b2f57f1d197d for instance with vm_state deleted and task_state None.
Oct 30 09:17:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "8883aff3-715a-4c96-8969-e41986cad31b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "8883aff3-715a-4c96-8969-e41986cad31b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "8883aff3-715a-4c96-8969-e41986cad31b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "8883aff3-715a-4c96-8969-e41986cad31b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "8883aff3-715a-4c96-8969-e41986cad31b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:27 user nova-compute[75017]: INFO nova.compute.manager [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Terminating instance
Oct 30 09:17:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:17:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Instance destroyed successfully.
Oct 30 09:17:28 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lazy-loading 'resources' on Instance uuid 8883aff3-715a-4c96-8969-e41986cad31b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2063575553',display_name='tempest-VolumesActionsTest-instance-2063575553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2063575553',id=11,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcd17cc193aa4827b94888db619cf93f',ramdisk_id='',reservation_id='r-0x6sk3zs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1324925892',owner_user_name='tempest-VolumesActionsTest-1324925892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:15:35Z,user_data=None,user_id='41bade78e9b24a15ab4016dc76a20931',uuid=8883aff3-715a-4c96-8969-e41986cad31b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converting VIF {"id": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "address": "fa:16:3e:4f:0d:e9", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c45b395-cc", "ovs_interfaceid": "8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0d:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c45b395-cc') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG os_vif [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0d:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c45b395-cc') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c45b395-cc, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85b117c9-1f30-4efd-84e4-51021d3ecf0b) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:28 user nova-compute[75017]: INFO os_vif [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0d:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c45b395-cc')
Oct 30 09:17:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Deleting instance files /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b_del
Oct 30 09:17:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Deletion of /opt/stack/data/nova/instances/8883aff3-715a-4c96-8969-e41986cad31b_del complete
Oct 30 09:17:28 user nova-compute[75017]: INFO nova.compute.manager [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Took 0.65 seconds to destroy the instance on the hypervisor.
Oct 30 09:17:28 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:17:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:29 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:29 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Took 1.59 seconds to deallocate network for instance.
Oct 30 09:17:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-aeddddc0-1a0c-4a26-879e-95d8b2949de4 req-75b0d688-ae08-4005-ac7a-8e61a31385c1 service nova] [instance: 8883aff3-715a-4c96-8969-e41986cad31b] Received event network-vif-deleted-8c45b395-cc1d-4109-b5ac-5b9c2b04fbf0 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:30 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:17:30 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:17:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:30 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Deleted allocations for instance 8883aff3-715a-4c96-8969-e41986cad31b
Oct 30 09:17:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f5d28093-858e-4af9-bfcc-cf6413cb364c tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "8883aff3-715a-4c96-8969-e41986cad31b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.908s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:17:32 user nova-compute[75017]: INFO nova.compute.claims [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Claim successful on node user
Oct 30 09:17:32 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:17:32 user nova-compute[75017]: DEBUG nova.network.neutron [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:17:33 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:17:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG nova.policy [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8849a4cff6941638c2461918c305c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e045f070c72c4a07b6041eba0e6bf7d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:17:33 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Creating image(s)
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk 1073741824" returned: 0 in 0.048s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG nova.network.neutron [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Successfully created port: 8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Cannot resize image /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Ensure instance console log exists: /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Successfully updated port: 8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquired lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-c6fbeba0-7209-4b9d-8af5-a2edda4ef16c req-889a85c9-b5cd-42db-9156-6f01b64099c4 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-changed-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-c6fbeba0-7209-4b9d-8af5-a2edda4ef16c req-889a85c9-b5cd-42db-9156-6f01b64099c4 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Refreshing instance network info cache due to event network-changed-8a2b14a4-3ecb-4c54-ac67-7917a612e660. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c6fbeba0-7209-4b9d-8af5-a2edda4ef16c req-889a85c9-b5cd-42db-9156-6f01b64099c4 service nova] Acquiring lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Releasing lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Instance network_info: |[{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c6fbeba0-7209-4b9d-8af5-a2edda4ef16c req-889a85c9-b5cd-42db-9156-6f01b64099c4 service nova] Acquired lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.network.neutron [req-c6fbeba0-7209-4b9d-8af5-a2edda4ef16c req-889a85c9-b5cd-42db-9156-6f01b64099c4 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Refreshing network info cache for port 8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Start _get_guest_xml network_info=[{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:17:34 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:17:34 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1160586145',display_name='tempest-ServerStableDeviceRescueTest-server-1160586145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1160586145',id=17,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSUxx57TJQCELhTTTGOfSKVi1iHah3q8zrlE9funAUn/G+GFr2dU6QazUmdaKFAc8RhvFTpouaaDWbh+QWRPsz7Wow/dlb3QsDFKzkjY5ZvvR4TPfqcnmlkyiQWdvU9Uw==',key_name='tempest-keypair-2000133269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e045f070c72c4a07b6041eba0e6bf7d0',ramdisk_id='',reservation_id='r-t70xmlyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1639847037',owner_user_name='tempest-ServerStableDeviceRescueTest-1639847037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8849a4cff6941638c2461918c305c86',uuid=3833002b-0acf-4093-8f10-097760487c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Converting VIF {"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=8a2b14a4-3ecb-4c54-ac67-7917a612e660,network=Network(935757fd-d9bf-4b7f-9a46-6479e87f7071),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2b14a4-3e') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.objects.instance [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'pci_devices' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:17:34 user nova-compute[75017]:   <uuid>3833002b-0acf-4093-8f10-097760487c73</uuid>
Oct 30 09:17:34 user nova-compute[75017]:   <name>instance-00000011</name>
Oct 30 09:17:34 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:17:34 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:17:34 user nova-compute[75017]:   <metadata>
Oct 30 09:17:34 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:17:34 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:17:34 user nova-compute[75017]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1160586145</nova:name>
Oct 30 09:17:34 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:17:34</nova:creationTime>
Oct 30 09:17:34 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:17:34 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:17:34 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:17:34 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:17:34 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:17:34 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:17:34 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:17:34 user nova-compute[75017]:       <nova:owner>
Oct 30 09:17:34 user nova-compute[75017]:         <nova:user uuid="b8849a4cff6941638c2461918c305c86">tempest-ServerStableDeviceRescueTest-1639847037-project-member</nova:user>
Oct 30 09:17:34 user nova-compute[75017]:         <nova:project uuid="e045f070c72c4a07b6041eba0e6bf7d0">tempest-ServerStableDeviceRescueTest-1639847037</nova:project>
Oct 30 09:17:34 user nova-compute[75017]:       </nova:owner>
Oct 30 09:17:34 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:17:34 user nova-compute[75017]:       <nova:ports>
Oct 30 09:17:34 user nova-compute[75017]:         <nova:port uuid="8a2b14a4-3ecb-4c54-ac67-7917a612e660">
Oct 30 09:17:34 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 09:17:34 user nova-compute[75017]:         </nova:port>
Oct 30 09:17:34 user nova-compute[75017]:       </nova:ports>
Oct 30 09:17:34 user nova-compute[75017]:     </nova:instance>
Oct 30 09:17:34 user nova-compute[75017]:   </metadata>
Oct 30 09:17:34 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:17:34 user nova-compute[75017]:     <system>
Oct 30 09:17:34 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:17:34 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:17:34 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:17:34 user nova-compute[75017]:       <entry name="serial">3833002b-0acf-4093-8f10-097760487c73</entry>
Oct 30 09:17:34 user nova-compute[75017]:       <entry name="uuid">3833002b-0acf-4093-8f10-097760487c73</entry>
Oct 30 09:17:34 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:17:34 user nova-compute[75017]:     </system>
Oct 30 09:17:34 user nova-compute[75017]:   </sysinfo>
Oct 30 09:17:34 user nova-compute[75017]:   <os>
Oct 30 09:17:34 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:17:34 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:17:34 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:17:34 user nova-compute[75017]:   </os>
Oct 30 09:17:34 user nova-compute[75017]:   <features>
Oct 30 09:17:34 user nova-compute[75017]:     <acpi/>
Oct 30 09:17:34 user nova-compute[75017]:     <apic/>
Oct 30 09:17:34 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:17:34 user nova-compute[75017]:   </features>
Oct 30 09:17:34 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:17:34 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:17:34 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:17:34 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:17:34 user nova-compute[75017]:   </clock>
Oct 30 09:17:34 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:17:34 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:17:34 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:17:34 user nova-compute[75017]:   </cpu>
Oct 30 09:17:34 user nova-compute[75017]:   <devices>
Oct 30 09:17:34 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:17:34 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:17:34 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk"/>
Oct 30 09:17:34 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:17:34 user nova-compute[75017]:     </disk>
Oct 30 09:17:34 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:17:34 user nova-compute[75017]:       <mac address="fa:16:3e:7a:7e:05"/>
Oct 30 09:17:34 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:17:34 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:17:34 user nova-compute[75017]:       <target dev="tap8a2b14a4-3e"/>
Oct 30 09:17:34 user nova-compute[75017]:     </interface>
Oct 30 09:17:34 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:17:34 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/console.log" append="off"/>
Oct 30 09:17:34 user nova-compute[75017]:     </serial>
Oct 30 09:17:34 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:17:34 user nova-compute[75017]:     <video>
Oct 30 09:17:34 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:17:34 user nova-compute[75017]:     </video>
Oct 30 09:17:34 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:17:34 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:17:34 user nova-compute[75017]:     </rng>
Oct 30 09:17:34 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:17:34 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:17:34 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:17:34 user nova-compute[75017]:     </memballoon>
Oct 30 09:17:34 user nova-compute[75017]:   </devices>
Oct 30 09:17:34 user nova-compute[75017]: </domain>
Oct 30 09:17:34 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1160586145',display_name='tempest-ServerStableDeviceRescueTest-server-1160586145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1160586145',id=17,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSUxx57TJQCELhTTTGOfSKVi1iHah3q8zrlE9funAUn/G+GFr2dU6QazUmdaKFAc8RhvFTpouaaDWbh+QWRPsz7Wow/dlb3QsDFKzkjY5ZvvR4TPfqcnmlkyiQWdvU9Uw==',key_name='tempest-keypair-2000133269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e045f070c72c4a07b6041eba0e6bf7d0',ramdisk_id='',reservation_id='r-t70xmlyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1639847037',owner_user_name='tempest-ServerStableDeviceRescueTest-1639847037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8849a4cff6941638c2461918c305c86',uuid=3833002b-0acf-4093-8f10-097760487c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Converting VIF {"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=8a2b14a4-3ecb-4c54-ac67-7917a612e660,network=Network(935757fd-d9bf-4b7f-9a46-6479e87f7071),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2b14a4-3e') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG os_vif [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=8a2b14a4-3ecb-4c54-ac67-7917a612e660,network=Network(935757fd-d9bf-4b7f-9a46-6479e87f7071),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2b14a4-3e') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '837bb5d3-1d04-5b3e-b96a-97cb4dd3fdee', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a2b14a4-3e, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a2b14a4-3e, col_values=(('qos', UUID('952f54d6-e038-42c1-a4d6-7943ae1f481e')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a2b14a4-3e, col_values=(('external_ids', {'iface-id': '8a2b14a4-3ecb-4c54-ac67-7917a612e660', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:7e:05', 'vm-uuid': '3833002b-0acf-4093-8f10-097760487c73'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:34 user nova-compute[75017]: INFO os_vif [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=8a2b14a4-3ecb-4c54-ac67-7917a612e660,network=Network(935757fd-d9bf-4b7f-9a46-6479e87f7071),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2b14a4-3e')
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:17:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] No VIF found with MAC fa:16:3e:7a:7e:05, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:17:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:35 user nova-compute[75017]: DEBUG nova.network.neutron [req-c6fbeba0-7209-4b9d-8af5-a2edda4ef16c req-889a85c9-b5cd-42db-9156-6f01b64099c4 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updated VIF entry in instance network info cache for port 8a2b14a4-3ecb-4c54-ac67-7917a612e660. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:17:35 user nova-compute[75017]: DEBUG nova.network.neutron [req-c6fbeba0-7209-4b9d-8af5-a2edda4ef16c req-889a85c9-b5cd-42db-9156-6f01b64099c4 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c6fbeba0-7209-4b9d-8af5-a2edda4ef16c req-889a85c9-b5cd-42db-9156-6f01b64099c4 service nova] Releasing lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-ea952a2e-cfd5-4c88-b456-3141c7fcb773 req-1ec9566f-0840-4399-88f3-790e5a1aa504 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ea952a2e-cfd5-4c88-b456-3141c7fcb773 req-1ec9566f-0840-4399-88f3-790e5a1aa504 service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ea952a2e-cfd5-4c88-b456-3141c7fcb773 req-1ec9566f-0840-4399-88f3-790e5a1aa504 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ea952a2e-cfd5-4c88-b456-3141c7fcb773 req-1ec9566f-0840-4399-88f3-790e5a1aa504 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-ea952a2e-cfd5-4c88-b456-3141c7fcb773 req-1ec9566f-0840-4399-88f3-790e5a1aa504 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:36 user nova-compute[75017]: WARNING nova.compute.manager [req-ea952a2e-cfd5-4c88-b456-3141c7fcb773 req-1ec9566f-0840-4399-88f3-790e5a1aa504 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state building and task_state spawning.
Oct 30 09:17:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:17:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 3833002b-0acf-4093-8f10-097760487c73] Instance spawned successfully.
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:17:38 user nova-compute[75017]: INFO nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Took 5.32 seconds to spawn the instance on the hypervisor.
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-24ec0600-7d56-497e-8441-ed65bbd231b0 req-640d6420-bc41-4afc-a1fe-18840a00d2f4 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-24ec0600-7d56-497e-8441-ed65bbd231b0 req-640d6420-bc41-4afc-a1fe-18840a00d2f4 service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-24ec0600-7d56-497e-8441-ed65bbd231b0 req-640d6420-bc41-4afc-a1fe-18840a00d2f4 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-24ec0600-7d56-497e-8441-ed65bbd231b0 req-640d6420-bc41-4afc-a1fe-18840a00d2f4 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-24ec0600-7d56-497e-8441-ed65bbd231b0 req-640d6420-bc41-4afc-a1fe-18840a00d2f4 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:38 user nova-compute[75017]: WARNING nova.compute.manager [req-24ec0600-7d56-497e-8441-ed65bbd231b0 req-640d6420-bc41-4afc-a1fe-18840a00d2f4 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state building and task_state spawning.
Oct 30 09:17:38 user nova-compute[75017]: INFO nova.compute.manager [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Took 6.12 seconds to build instance.
Oct 30 09:17:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-41f920a3-1923-4a4f-bca4-5869b870e645 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.213s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-2799f152-9e9b-4298-871f-3e12a93144d4 req-c736c829-9629-490e-a7a4-5487ee661b02 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-changed-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-2799f152-9e9b-4298-871f-3e12a93144d4 req-c736c829-9629-490e-a7a4-5487ee661b02 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing instance network info cache due to event network-changed-c75be99b-5a95-4330-acbb-12f982a1c492. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:17:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2799f152-9e9b-4298-871f-3e12a93144d4 req-c736c829-9629-490e-a7a4-5487ee661b02 service nova] Acquiring lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:17:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2799f152-9e9b-4298-871f-3e12a93144d4 req-c736c829-9629-490e-a7a4-5487ee661b02 service nova] Acquired lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:17:45 user nova-compute[75017]: DEBUG nova.network.neutron [req-2799f152-9e9b-4298-871f-3e12a93144d4 req-c736c829-9629-490e-a7a4-5487ee661b02 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Refreshing network info cache for port c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:17:46 user nova-compute[75017]: DEBUG nova.network.neutron [req-2799f152-9e9b-4298-871f-3e12a93144d4 req-c736c829-9629-490e-a7a4-5487ee661b02 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updated VIF entry in instance network info cache for port c75be99b-5a95-4330-acbb-12f982a1c492. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:17:46 user nova-compute[75017]: DEBUG nova.network.neutron [req-2799f152-9e9b-4298-871f-3e12a93144d4 req-c736c829-9629-490e-a7a4-5487ee661b02 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [{"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2799f152-9e9b-4298-871f-3e12a93144d4 req-c736c829-9629-490e-a7a4-5487ee661b02 service nova] Releasing lock "refresh_cache-e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:48 user nova-compute[75017]: INFO nova.compute.manager [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Terminating instance
Oct 30 09:17:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-de71e07c-b336-4ca5-9cb8-522db9582088 req-5663a4e9-4c48-4eb2-b43b-90435ddaa408 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-de71e07c-b336-4ca5-9cb8-522db9582088 req-5663a4e9-4c48-4eb2-b43b-90435ddaa408 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-de71e07c-b336-4ca5-9cb8-522db9582088 req-5663a4e9-4c48-4eb2-b43b-90435ddaa408 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-de71e07c-b336-4ca5-9cb8-522db9582088 req-5663a4e9-4c48-4eb2-b43b-90435ddaa408 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-de71e07c-b336-4ca5-9cb8-522db9582088 req-5663a4e9-4c48-4eb2-b43b-90435ddaa408 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-unplugged-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-de71e07c-b336-4ca5-9cb8-522db9582088 req-5663a4e9-4c48-4eb2-b43b-90435ddaa408 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-c75be99b-5a95-4330-acbb-12f982a1c492 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-e5d0a576-3390-48a4-80d8-d0e863a54293 req-912864a5-92de-408e-aee1-0435a1884756 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e5d0a576-3390-48a4-80d8-d0e863a54293 req-912864a5-92de-408e-aee1-0435a1884756 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e5d0a576-3390-48a4-80d8-d0e863a54293 req-912864a5-92de-408e-aee1-0435a1884756 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e5d0a576-3390-48a4-80d8-d0e863a54293 req-912864a5-92de-408e-aee1-0435a1884756 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-e5d0a576-3390-48a4-80d8-d0e863a54293 req-912864a5-92de-408e-aee1-0435a1884756 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-unplugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-e5d0a576-3390-48a4-80d8-d0e863a54293 req-912864a5-92de-408e-aee1-0435a1884756 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-b09e0ac4-f306-458e-82ac-f2452fc80ec1 req-1ed6043c-a6bb-4b21-889e-4f30de7915a1 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b09e0ac4-f306-458e-82ac-f2452fc80ec1 req-1ed6043c-a6bb-4b21-889e-4f30de7915a1 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b09e0ac4-f306-458e-82ac-f2452fc80ec1 req-1ed6043c-a6bb-4b21-889e-4f30de7915a1 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b09e0ac4-f306-458e-82ac-f2452fc80ec1 req-1ed6043c-a6bb-4b21-889e-4f30de7915a1 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-b09e0ac4-f306-458e-82ac-f2452fc80ec1 req-1ed6043c-a6bb-4b21-889e-4f30de7915a1 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-unplugged-288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-b09e0ac4-f306-458e-82ac-f2452fc80ec1 req-1ed6043c-a6bb-4b21-889e-4f30de7915a1 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-288a1cda-73d5-4222-a7a9-5657efaa45da for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Instance destroyed successfully.
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.objects.instance [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lazy-loading 'resources' on Instance uuid e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:2d:08,bridge_name='br-int',has_traffic_filtering=True,id=c75be99b-5a95-4330-acbb-12f982a1c492,network=Network(3ead5234-8276-41ed-b788-f2ebf3724feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75be99b-5a') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:2d:08,bridge_name='br-int',has_traffic_filtering=True,id=c75be99b-5a95-4330-acbb-12f982a1c492,network=Network(3ead5234-8276-41ed-b788-f2ebf3724feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75be99b-5a') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc75be99b-5a, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6559f94c-f881-49cc-9343-777b40fac7ae) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: INFO os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:2d:08,bridge_name='br-int',has_traffic_filtering=True,id=c75be99b-5a95-4330-acbb-12f982a1c492,network=Network(3ead5234-8276-41ed-b788-f2ebf3724feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75be99b-5a')
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2c:4d,bridge_name='br-int',has_traffic_filtering=True,id=8bf40fff-eeab-4a60-ae57-e3229ebac120,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bf40fff-ee') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2c:4d,bridge_name='br-int',has_traffic_filtering=True,id=8bf40fff-eeab-4a60-ae57-e3229ebac120,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bf40fff-ee') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bf40fff-ee, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe44e45d-f86a-47df-aeb9-6c675acccb6f) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: INFO os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2c:4d,bridge_name='br-int',has_traffic_filtering=True,id=8bf40fff-eeab-4a60-ae57-e3229ebac120,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bf40fff-ee')
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:8a,bridge_name='br-int',has_traffic_filtering=True,id=288a1cda-73d5-4222-a7a9-5657efaa45da,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap288a1cda-73') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:8a,bridge_name='br-int',has_traffic_filtering=True,id=288a1cda-73d5-4222-a7a9-5657efaa45da,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap288a1cda-73') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap288a1cda-73, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=527a49e9-0da4-4bad-b90d-d47fed29b60e) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: INFO os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:8a,bridge_name='br-int',has_traffic_filtering=True,id=288a1cda-73d5-4222-a7a9-5657efaa45da,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap288a1cda-73')
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "49e4404a-1322-473f-bb99-9ba80c17d01f", "address": "fa:16:3e:a5:5b:ce", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e4404a-13", "ovs_interfaceid": "49e4404a-1322-473f-bb99-9ba80c17d01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:5b:ce,bridge_name='br-int',has_traffic_filtering=True,id=49e4404a-1322-473f-bb99-9ba80c17d01f,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e4404a-13') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:5b:ce,bridge_name='br-int',has_traffic_filtering=True,id=49e4404a-1322-473f-bb99-9ba80c17d01f,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e4404a-13') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49e4404a-13, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8305d63-d226-4381-ad68-352a69078e10) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: INFO os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:5b:ce,bridge_name='br-int',has_traffic_filtering=True,id=49e4404a-1322-473f-bb99-9ba80c17d01f,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e4404a-13')
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:be:36,bridge_name='br-int',has_traffic_filtering=True,id=e924d1fa-1e09-4b03-a940-0408f564be1e,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape924d1fa-1e') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:be:36,bridge_name='br-int',has_traffic_filtering=True,id=e924d1fa-1e09-4b03-a940-0408f564be1e,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape924d1fa-1e') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape924d1fa-1e, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59d35d98-2e14-4d10-b2d0-d84f62eb9238) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING nova.compute.manager [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-c75be99b-5a95-4330-acbb-12f982a1c492 for instance with vm_state active and task_state deleting.
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-unplugged-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-49e4404a-1322-473f-bb99-9ba80c17d01f for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING nova.compute.manager [req-91055384-a0ba-45f0-bd33-9572a7b51ec9 req-78b4043f-e0a0-4d9a-ab0d-775e939af376 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-49e4404a-1322-473f-bb99-9ba80c17d01f for instance with vm_state active and task_state deleting.
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: INFO os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:be:36,bridge_name='br-int',has_traffic_filtering=True,id=e924d1fa-1e09-4b03-a940-0408f564be1e,network=Network(19c6c2da-20fe-4d1c-84a4-0b506daf1590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape924d1fa-1e')
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:19,bridge_name='br-int',has_traffic_filtering=True,id=6009b5bc-376f-4b61-8e1c-b0bb4864c686,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009b5bc-37') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:19,bridge_name='br-int',has_traffic_filtering=True,id=6009b5bc-376f-4b61-8e1c-b0bb4864c686,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009b5bc-37') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-8bf40fff-eeab-4a60-ae57-e3229ebac120 for instance with vm_state active and task_state deleting.
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-unplugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-6009b5bc-376f-4b61-8e1c-b0bb4864c686 for instance with vm_state active and task_state deleting.
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-unplugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING nova.compute.manager [req-c06ab79b-9fa9-4604-b7ce-a6df6bf88040 req-549a6528-5662-4b17-bcdc-078561167a48 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-e0f83c4e-90a4-46d9-852a-91a732e2fdde for instance with vm_state active and task_state deleting.
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6009b5bc-37, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d19b195-6b39-42a7-a593-b04ee16a700c) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: INFO os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:19,bridge_name='br-int',has_traffic_filtering=True,id=6009b5bc-376f-4b61-8e1c-b0bb4864c686,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009b5bc-37')
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1320251861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1320251861',id=10,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtusAGQ/1wuj5Tf+Sg7QqYIPQouu/AUx3NjaoRbc1ZoY0UuhxywTQex3AF6GC7Nx7DUHP0Z8kU7U2x0Za12tOcbJy6J3voioq1d2MJh7/agZTvsouNG5/BLPWufMQZerw==',key_name='tempest-keypair-2006333001',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4965ad5176314c298c0e1ce3cf0995f4',ramdisk_id='',reservation_id='r-9i2zu0z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474711768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474711768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b6d1aed2074fa7a74256a8764b44bc',uuid=e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converting VIF {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0f83c4e-90a4-46d9-852a-91a732e2fdde,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f83c4e-90') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0f83c4e-90a4-46d9-852a-91a732e2fdde,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f83c4e-90') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0f83c4e-90, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce9905f9-a482-43db-903a-75a5392c2c53) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:17:51 user nova-compute[75017]: INFO os_vif [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0f83c4e-90a4-46d9-852a-91a732e2fdde,network=Network(78642e6c-f527-48e5-a936-31db98b2da69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f83c4e-90')
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRXvIBxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[293c5f9c-44d3-4009-b7c0-bb9c25f99fbd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:17:51 user nova-compute[75017]: No targets found.
Oct 30 09:17:51 user nova-compute[75017]: iSNS:
Oct 30 09:17:51 user nova-compute[75017]: No targets found.
Oct 30 09:17:51 user nova-compute[75017]: STATIC:
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: FIRMWARE:
Oct 30 09:17:51 user nova-compute[75017]: No targets found.
Oct 30 09:17:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:17:51 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:17:51 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a2296d-e39f-4ecc-9cb0-dd9e29f8917c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a351ffe-283a-4a7a-a495-5841d314ddf4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd64430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[de23f9bb-db54-4cf4-8b3f-e5c2880a9000]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0161c51d-f662-4af7-859a-2366b4e19d99]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f230be72-78ff-4f1c-b28c-60e49850969a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710f959-3e01-4b0e-95db-628f3a08053d]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c921736b-24e7-49e5-93e1-b319a1e55b20]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-288a1cda-73d5-4222-a7a9-5657efaa45da {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING nova.compute.manager [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-288a1cda-73d5-4222-a7a9-5657efaa45da for instance with vm_state active and task_state deleting.
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-unplugged-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-unplugged-e924d1fa-1e09-4b03-a940-0408f564be1e for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-plugged-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] Acquiring lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] No waiting events found dispatching network-vif-plugged-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING nova.compute.manager [req-565f4c32-6b41-43ae-9ec2-8c52085fb2fc req-bf76d08a-4058-4dc7-ad0d-dba40697a730 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received unexpected event network-vif-plugged-e924d1fa-1e09-4b03-a940-0408f564be1e for instance with vm_state active and task_state deleting.
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a83a8dc-4f6a-4b08-8d03-a6de1f597663]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78, portal: 172.16.0.220,3260]
Oct 30 09:17:51 user nova-compute[75017]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78, portal: 172.16.0.220,3260] successful.
Oct 30 09:17:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ad41d5-afce-494c-b728-29ade5213a78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e036d895-36b1-4b75-afb0-04e29d12e2cf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] <== disconnect_volume: return (367ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHKcWlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[be226f6c-ff55-4b44-9b69-5e73ba52b6c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:17:51 user nova-compute[75017]: No targets found.
Oct 30 09:17:51 user nova-compute[75017]: iSNS:
Oct 30 09:17:51 user nova-compute[75017]: No targets found.
Oct 30 09:17:51 user nova-compute[75017]: STATIC:
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: FIRMWARE:
Oct 30 09:17:51 user nova-compute[75017]: No targets found.
Oct 30 09:17:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:17:51 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:17:51 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5117ed-1c43-46b3-a128-c34e6b48327a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e4e0c6-e1eb-4726-a689-89aaee107fb9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:51 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd64430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b'): ({'sdi'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Removing single pathed devices sdi {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ea6eea-1a90-4a5a-8fd5-185bee72b1d6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[500be574-0172-497b-a329-bf1d6a0215f8]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Flushing IO for device /dev/sdi {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e9d7b9-4383-4d75-8519-1d6e3839b128]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ee221e-304b-4459-9d93-3f2eaa2f15df]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] SCSI volumes sdi have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cd0b35-cefa-4e12-bdaa-542e29249404]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[76263064-af3f-464b-a512-eb425318308f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b, portal: 172.16.0.220,3260]
Oct 30 09:17:51 user nova-compute[75017]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b, portal: 172.16.0.220,3260] successful.
Oct 30 09:17:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d50bc-a569-4ca3-9fc0-d9fe061b5d4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0ef984-afbc-4c63-9bf1-dbc4f41d87ed]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] <== disconnect_volume: return (339ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDsgbqWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:17:51 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2bd323-e68f-4a38-94ba-18305f3d3fe5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:17:51 user nova-compute[75017]: No targets found.
Oct 30 09:17:51 user nova-compute[75017]: iSNS:
Oct 30 09:17:51 user nova-compute[75017]: No targets found.
Oct 30 09:17:51 user nova-compute[75017]: STATIC:
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244
Oct 30 09:17:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:17:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:17:51 user nova-compute[75017]: FIRMWARE:
Oct 30 09:17:51 user nova-compute[75017]: No targets found.
Oct 30 09:17:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:17:51 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:17:51 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13659db-6124-4cf1-bab5-da71c919f3e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea57d8d-5c45-4395-b314-7d36b4b5a2e9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:52 user nova-compute[75017]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:17:52 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:52 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 (non-flash)
Oct 30 09:17:52 user nova-compute[75017]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:17:52 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:17:52 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:17:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd64430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1'): ({'sdj'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Removing single pathed devices sdj {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a82c1-e79b-40c1-afbd-7213422b65f5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1573a6-96c9-427f-ab08-44f2206e2672]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Flushing IO for device /dev/sdj {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[00de6b04-42a7-436a-ba6e-96ef171d487e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[41647dec-2a93-4814-9ffb-031a55ea986a]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] SCSI volumes sdj have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f26a37-04de-423b-af9b-c4709e4566c1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[824ff7ea-fa19-449a-99c5-a6e27549953d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1, portal: 172.16.0.220,3260]
Oct 30 09:17:52 user nova-compute[75017]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1, portal: 172.16.0.220,3260] successful.
Oct 30 09:17:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f577a2-5b80-4c55-a271-a20fa82fc6c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c07b9d-b886-4bb3-89ea-feb7471639a7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] <== disconnect_volume: return (356ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:17:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Deleting instance files /opt/stack/data/nova/instances/e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9_del
Oct 30 09:17:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Deletion of /opt/stack/data/nova/instances/e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9_del complete
Oct 30 09:17:52 user nova-compute[75017]: INFO nova.compute.manager [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Took 3.83 seconds to destroy the instance on the hypervisor.
Oct 30 09:17:52 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:17:52 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:17:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-484d8bfd-eb21-4f6c-b162-881a20a47778 req-5f829fff-c1f8-42d5-bb38-47a0e1179765 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-deleted-49e4404a-1322-473f-bb99-9ba80c17d01f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:54 user nova-compute[75017]: INFO nova.compute.manager [req-484d8bfd-eb21-4f6c-b162-881a20a47778 req-5f829fff-c1f8-42d5-bb38-47a0e1179765 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Neutron deleted interface 49e4404a-1322-473f-bb99-9ba80c17d01f; detaching it from the instance and deleting it from the info cache
Oct 30 09:17:54 user nova-compute[75017]: DEBUG nova.network.neutron [req-484d8bfd-eb21-4f6c-b162-881a20a47778 req-5f829fff-c1f8-42d5-bb38-47a0e1179765 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [{"id": "c75be99b-5a95-4330-acbb-12f982a1c492", "address": "fa:16:3e:81:2d:08", "network": {"id": "3ead5234-8276-41ed-b788-f2ebf3724feb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168934139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75be99b-5a", "ovs_interfaceid": "c75be99b-5a95-4330-acbb-12f982a1c492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-484d8bfd-eb21-4f6c-b162-881a20a47778 req-5f829fff-c1f8-42d5-bb38-47a0e1179765 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Detach interface failed, port_id=49e4404a-1322-473f-bb99-9ba80c17d01f, reason: Instance e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:17:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-deleted-c75be99b-5a95-4330-acbb-12f982a1c492 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:56 user nova-compute[75017]: INFO nova.compute.manager [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Neutron deleted interface c75be99b-5a95-4330-acbb-12f982a1c492; detaching it from the instance and deleting it from the info cache
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [{"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "address": "fa:16:3e:0d:84:ac", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f83c4e-90", "ovs_interfaceid": "e0f83c4e-90a4-46d9-852a-91a732e2fdde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Detach interface failed, port_id=c75be99b-5a95-4330-acbb-12f982a1c492, reason: Instance e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-deleted-e0f83c4e-90a4-46d9-852a-91a732e2fdde {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:56 user nova-compute[75017]: INFO nova.compute.manager [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Neutron deleted interface e0f83c4e-90a4-46d9-852a-91a732e2fdde; detaching it from the instance and deleting it from the info cache
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [{"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "address": "fa:16:3e:52:84:19", "network": {"id": "78642e6c-f527-48e5-a936-31db98b2da69", "bridge": "br-int", "label": "tempest-device-tagging-net2-612378156", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009b5bc-37", "ovs_interfaceid": "6009b5bc-376f-4b61-8e1c-b0bb4864c686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Detach interface failed, port_id=e0f83c4e-90a4-46d9-852a-91a732e2fdde, reason: Instance e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-deleted-6009b5bc-376f-4b61-8e1c-b0bb4864c686 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:56 user nova-compute[75017]: INFO nova.compute.manager [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Neutron deleted interface 6009b5bc-376f-4b61-8e1c-b0bb4864c686; detaching it from the instance and deleting it from the info cache
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [{"id": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "address": "fa:16:3e:d8:2c:4d", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf40fff-ee", "ovs_interfaceid": "8bf40fff-eeab-4a60-ae57-e3229ebac120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288a1cda-73d5-4222-a7a9-5657efaa45da", "address": "fa:16:3e:9f:0a:8a", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288a1cda-73", "ovs_interfaceid": "288a1cda-73d5-4222-a7a9-5657efaa45da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e924d1fa-1e09-4b03-a940-0408f564be1e", "address": "fa:16:3e:fd:be:36", "network": {"id": "19c6c2da-20fe-4d1c-84a4-0b506daf1590", "bridge": "br-int", "label": "tempest-device-tagging-net1-51684172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4965ad5176314c298c0e1ce3cf0995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape924d1fa-1e", "ovs_interfaceid": "e924d1fa-1e09-4b03-a940-0408f564be1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6638d91-6c9e-4042-962a-d9105ce67a6b req-d0e556c6-70cd-4a47-a9ba-c3779c14dce3 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Detach interface failed, port_id=6009b5bc-376f-4b61-8e1c-b0bb4864c686, reason: Instance e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:17:56 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:17:57 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Took 4.63 seconds to deallocate network for instance.
Oct 30 09:17:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-9a856337-d733-4015-af01-7f130bef7aed req-a05d6360-d433-48e5-a8e4-9e3d676e5834 service nova] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Received event network-vif-deleted-e924d1fa-1e09-4b03-a940-0408f564be1e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:17:59 user nova-compute[75017]: INFO nova.compute.manager [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] [instance: e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9] Took 2.63 seconds to detach 3 volumes for instance.
Oct 30 09:17:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:17:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:00 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:18:00 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:18:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:00 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Deleted allocations for instance e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9
Oct 30 09:18:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-59d3b7e4-8fdc-47f7-bf05-f2e45bd8963c tempest-TaggedBootDevicesTest_v242-1474711768 tempest-TaggedBootDevicesTest_v242-1474711768-project-member] Lock "e5fccdc0-c08f-4c9e-8f61-4299cda1a6c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.731s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:03 user nova-compute[75017]: INFO nova.compute.manager [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Rescuing
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquired lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-1d2a047e-b5af-485c-be36-a94de9161468 req-475f8e96-ad32-483c-9895-3fc679a80dbe service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received event network-changed-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-1d2a047e-b5af-485c-be36-a94de9161468 req-475f8e96-ad32-483c-9895-3fc679a80dbe service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Refreshing instance network info cache due to event network-changed-8c6c6da9-86d9-442f-905d-7f96f9dc53cf. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1d2a047e-b5af-485c-be36-a94de9161468 req-475f8e96-ad32-483c-9895-3fc679a80dbe service nova] Acquiring lock "refresh_cache-75bb6699-a0c6-4f04-9fca-b0c20b6c0162" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1d2a047e-b5af-485c-be36-a94de9161468 req-475f8e96-ad32-483c-9895-3fc679a80dbe service nova] Acquired lock "refresh_cache-75bb6699-a0c6-4f04-9fca-b0c20b6c0162" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-1d2a047e-b5af-485c-be36-a94de9161468 req-475f8e96-ad32-483c-9895-3fc679a80dbe service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Refreshing network info cache for port 8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updating instance_info_cache with network_info: [{"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Releasing lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-1d2a047e-b5af-485c-be36-a94de9161468 req-475f8e96-ad32-483c-9895-3fc679a80dbe service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Updated VIF entry in instance network info cache for port 8c6c6da9-86d9-442f-905d-7f96f9dc53cf. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-1d2a047e-b5af-485c-be36-a94de9161468 req-475f8e96-ad32-483c-9895-3fc679a80dbe service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Updating instance_info_cache with network_info: [{"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lazy-loading 'flavor' on Instance uuid 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1d2a047e-b5af-485c-be36-a94de9161468 req-475f8e96-ad32-483c-9895-3fc679a80dbe service nova] Releasing lock "refresh_cache-75bb6699-a0c6-4f04-9fca-b0c20b6c0162" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:03 user nova-compute[75017]: INFO nova.compute.manager [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Attaching volume 76578c94-dbfd-4ae7-a51e-d1113879fc14 to /dev/vdb
Oct 30 09:18:04 user nova-compute[75017]: DEBUG os_brick.utils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd925661-9084-4db9-bdfe-c974a6111545]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bc95d6-a7d7-4fa8-8b41-b68e03b84fee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6241a849-fb19-4274-9bbc-9899c9c9c2eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddc176f-bb98-4d0d-ab5e-5baa15170850]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:18:04 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a40ba2-e62a-466d-a973-018b2d6bdef0]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG os_brick.utils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Updating existing volume attachment record: 0f348945-318b-402e-8cd8-bccddbdc36d0 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:18:04 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Instance destroyed successfully.
Oct 30 09:18:04 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Attempting rescue
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75017) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Instance directory exists: not creating {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 09:18:04 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Creating image(s)
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.instance [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-bdb60d39-bbfe-4ea0-b16f-964615a84e30 req-7d44f75b-f033-4e56-8315-f485fff995ad service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-unplugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bdb60d39-bbfe-4ea0-b16f-964615a84e30 req-7d44f75b-f033-4e56-8315-f485fff995ad service nova] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bdb60d39-bbfe-4ea0-b16f-964615a84e30 req-7d44f75b-f033-4e56-8315-f485fff995ad service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bdb60d39-bbfe-4ea0-b16f-964615a84e30 req-7d44f75b-f033-4e56-8315-f485fff995ad service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-bdb60d39-bbfe-4ea0-b16f-964615a84e30 req-7d44f75b-f033-4e56-8315-f485fff995ad service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] No waiting events found dispatching network-vif-unplugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:04 user nova-compute[75017]: WARNING nova.compute.manager [req-bdb60d39-bbfe-4ea0-b16f-964615a84e30 req-7d44f75b-f033-4e56-8315-f485fff995ad service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received unexpected event network-vif-unplugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 for instance with vm_state active and task_state rescuing.
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue" returned: 0 in 0.047s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.instance [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'migration_context' on Instance uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.base [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<7ce43b8f-adcf-4650-9b56-8558ca386fe7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Start _get_guest_xml network_info=[{"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "vif_mac": "fa:16:3e:2f:af:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.instance [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'resources' on Instance uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.base [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<7ce43b8f-adcf-4650-9b56-8558ca386fe7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.instance [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.base [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<7ce43b8f-adcf-4650-9b56-8558ca386fe7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:18:04 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:18:04 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.instance [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.base [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<7ce43b8f-adcf-4650-9b56-8558ca386fe7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1187124425',display_name='tempest-ServerRescueNegativeTestJSON-server-1187124425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1187124425',id=15,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-3v4aele9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:24Z,user_data=None,user_id='e7b340dac0544150bc642f7ecfb07157',uuid=7ce43b8f-adcf-4650-9b56-8558ca386fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "vif_mac": "fa:16:3e:2f:af:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "vif_mac": "fa:16:3e:2f:af:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:af:95,bridge_name='br-int',has_traffic_filtering=True,id=8099d535-21b3-4fcb-90eb-5680fb503fa1,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099d535-21') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.instance [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.objects.base [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<7ce43b8f-adcf-4650-9b56-8558ca386fe7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:18:04 user nova-compute[75017]:   <uuid>7ce43b8f-adcf-4650-9b56-8558ca386fe7</uuid>
Oct 30 09:18:04 user nova-compute[75017]:   <name>instance-0000000f</name>
Oct 30 09:18:04 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:18:04 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:18:04 user nova-compute[75017]:   <metadata>
Oct 30 09:18:04 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:18:04 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:18:04 user nova-compute[75017]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1187124425</nova:name>
Oct 30 09:18:04 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:18:04</nova:creationTime>
Oct 30 09:18:04 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:18:04 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:18:04 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:18:04 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:18:04 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:18:04 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:18:04 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:18:04 user nova-compute[75017]:       <nova:owner>
Oct 30 09:18:04 user nova-compute[75017]:         <nova:user uuid="e7b340dac0544150bc642f7ecfb07157">tempest-ServerRescueNegativeTestJSON-1002551965-project-member</nova:user>
Oct 30 09:18:04 user nova-compute[75017]:         <nova:project uuid="8c1e0e03de5c497a94c9c6267e623573">tempest-ServerRescueNegativeTestJSON-1002551965</nova:project>
Oct 30 09:18:04 user nova-compute[75017]:       </nova:owner>
Oct 30 09:18:04 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:18:04 user nova-compute[75017]:       <nova:ports>
Oct 30 09:18:04 user nova-compute[75017]:         <nova:port uuid="8099d535-21b3-4fcb-90eb-5680fb503fa1">
Oct 30 09:18:04 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 09:18:04 user nova-compute[75017]:         </nova:port>
Oct 30 09:18:04 user nova-compute[75017]:       </nova:ports>
Oct 30 09:18:04 user nova-compute[75017]:     </nova:instance>
Oct 30 09:18:04 user nova-compute[75017]:   </metadata>
Oct 30 09:18:04 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:18:04 user nova-compute[75017]:     <system>
Oct 30 09:18:04 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:18:04 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:18:04 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:18:04 user nova-compute[75017]:       <entry name="serial">7ce43b8f-adcf-4650-9b56-8558ca386fe7</entry>
Oct 30 09:18:04 user nova-compute[75017]:       <entry name="uuid">7ce43b8f-adcf-4650-9b56-8558ca386fe7</entry>
Oct 30 09:18:04 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:18:04 user nova-compute[75017]:     </system>
Oct 30 09:18:04 user nova-compute[75017]:   </sysinfo>
Oct 30 09:18:04 user nova-compute[75017]:   <os>
Oct 30 09:18:04 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:18:04 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:18:04 user nova-compute[75017]:   </os>
Oct 30 09:18:04 user nova-compute[75017]:   <features>
Oct 30 09:18:04 user nova-compute[75017]:     <acpi/>
Oct 30 09:18:04 user nova-compute[75017]:     <apic/>
Oct 30 09:18:04 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:18:04 user nova-compute[75017]:   </features>
Oct 30 09:18:04 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:18:04 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:18:04 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:18:04 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:18:04 user nova-compute[75017]:   </clock>
Oct 30 09:18:04 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:18:04 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:18:04 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:18:04 user nova-compute[75017]:   </cpu>
Oct 30 09:18:04 user nova-compute[75017]:   <devices>
Oct 30 09:18:04 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:18:04 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:18:04 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue"/>
Oct 30 09:18:04 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:18:04 user nova-compute[75017]:     </disk>
Oct 30 09:18:04 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:18:04 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:18:04 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk"/>
Oct 30 09:18:04 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:18:04 user nova-compute[75017]:     </disk>
Oct 30 09:18:04 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:18:04 user nova-compute[75017]:       <mac address="fa:16:3e:2f:af:95"/>
Oct 30 09:18:04 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:18:04 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:18:04 user nova-compute[75017]:       <target dev="tap8099d535-21"/>
Oct 30 09:18:04 user nova-compute[75017]:     </interface>
Oct 30 09:18:04 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:18:04 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/console.log" append="off"/>
Oct 30 09:18:04 user nova-compute[75017]:     </serial>
Oct 30 09:18:04 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:18:04 user nova-compute[75017]:     <video>
Oct 30 09:18:04 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:18:04 user nova-compute[75017]:     </video>
Oct 30 09:18:04 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:18:04 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:18:04 user nova-compute[75017]:     </rng>
Oct 30 09:18:04 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:18:04 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:18:04 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:18:04 user nova-compute[75017]:     </memballoon>
Oct 30 09:18:04 user nova-compute[75017]:   </devices>
Oct 30 09:18:04 user nova-compute[75017]: </domain>
Oct 30 09:18:04 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:18:04 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Instance destroyed successfully.
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:18:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No VIF found with MAC fa:16:3e:2f:af:95, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:18:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-39243a34-dd08-41b6-931f-7685aa20edf1 req-7dd24796-239b-4204-a04e-18c808d20fd4 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-39243a34-dd08-41b6-931f-7685aa20edf1 req-7dd24796-239b-4204-a04e-18c808d20fd4 service nova] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-39243a34-dd08-41b6-931f-7685aa20edf1 req-7dd24796-239b-4204-a04e-18c808d20fd4 service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-39243a34-dd08-41b6-931f-7685aa20edf1 req-7dd24796-239b-4204-a04e-18c808d20fd4 service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-39243a34-dd08-41b6-931f-7685aa20edf1 req-7dd24796-239b-4204-a04e-18c808d20fd4 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] No waiting events found dispatching network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:06 user nova-compute[75017]: WARNING nova.compute.manager [req-39243a34-dd08-41b6-931f-7685aa20edf1 req-7dd24796-239b-4204-a04e-18c808d20fd4 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received unexpected event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 for instance with vm_state active and task_state rescuing.
Oct 30 09:18:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] No waiting events found dispatching network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:08 user nova-compute[75017]: WARNING nova.compute.manager [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received unexpected event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 for instance with vm_state active and task_state rescuing.
Oct 30 09:18:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] No waiting events found dispatching network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:08 user nova-compute[75017]: WARNING nova.compute.manager [req-0d563898-30d8-4f99-8bc7-6b9ad088c071 req-3afd9caa-e02d-451f-9b02-87f46d540557 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received unexpected event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 for instance with vm_state active and task_state rescuing.
Oct 30 09:18:08 user nova-compute[75017]: DEBUG nova.compute.manager [None req-67dfa3ed-756b-4a9d-a647-4cc15a324638 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:18:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:10 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:10 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:10 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:18:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:11 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:12 user nova-compute[75017]: INFO nova.compute.manager [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Detaching volume 5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:12 user nova-compute[75017]: INFO nova.virt.block_device [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Attempting to driver detach volume 5cdb7bf0-270f-433e-b323-88c35d27d339 from mountpoint /dev/vdb
Oct 30 09:18:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Attempting to detach device vdb from instance d46e94f6-465d-4112-868e-acf8cea4f402 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:18:12 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:18:12 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:18:12 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:18:12 user nova-compute[75017]:   <serial>5cdb7bf0-270f-433e-b323-88c35d27d339</serial>
Oct 30 09:18:12 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:18:12 user nova-compute[75017]: </disk>
Oct 30 09:18:12 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:18:12 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully detached device vdb from instance d46e94f6-465d-4112-868e-acf8cea4f402 from the persistent domain config.
Oct 30 09:18:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d46e94f6-465d-4112-868e-acf8cea4f402 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:18:12 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:18:12 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:18:12 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:18:12 user nova-compute[75017]:   <serial>5cdb7bf0-270f-433e-b323-88c35d27d339</serial>
Oct 30 09:18:12 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:18:12 user nova-compute[75017]: </disk>
Oct 30 09:18:12 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:18:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d46e94f6-465d-4112-868e-acf8cea4f402 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:16 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:18:16 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7391MB free_disk=25.43476104736328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d46e94f6-465d-4112-868e-acf8cea4f402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance df215875-673c-4446-afa1-3446ff63edbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5a294811-e03d-4034-871d-db6ba2ad721d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 301352c4-d76d-4564-af67-0cafdc6c893b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 3833002b-0acf-4093-8f10-097760487c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:18:16 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "d70af571-8573-4ef5-82e8-9b30084616df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "d70af571-8573-4ef5-82e8-9b30084616df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:18:20 user nova-compute[75017]: INFO nova.compute.claims [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Claim successful on node user
Oct 30 09:18:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:18:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.policy [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41bade78e9b24a15ab4016dc76a20931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd17cc193aa4827b94888db619cf93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:18:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Creating image(s)
Oct 30 09:18:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "/opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "/opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "/opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.205s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk 1073741824" returned: 0 in 0.064s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Successfully created port: 2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.225s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Cannot resize image /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Ensure instance console log exists: /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Successfully updated port: 2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-72e31af3-4368-4b27-914a-b60da2845411 req-c39c92c0-019e-476b-bb3c-8f99ce4db6f4 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received event network-changed-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-72e31af3-4368-4b27-914a-b60da2845411 req-c39c92c0-019e-476b-bb3c-8f99ce4db6f4 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Refreshing instance network info cache due to event network-changed-2e242288-e4f1-4f5b-a894-0116273c5757. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-72e31af3-4368-4b27-914a-b60da2845411 req-c39c92c0-019e-476b-bb3c-8f99ce4db6f4 service nova] Acquiring lock "refresh_cache-d70af571-8573-4ef5-82e8-9b30084616df" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-72e31af3-4368-4b27-914a-b60da2845411 req-c39c92c0-019e-476b-bb3c-8f99ce4db6f4 service nova] Acquired lock "refresh_cache-d70af571-8573-4ef5-82e8-9b30084616df" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG nova.network.neutron [req-72e31af3-4368-4b27-914a-b60da2845411 req-c39c92c0-019e-476b-bb3c-8f99ce4db6f4 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Refreshing network info cache for port 2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "refresh_cache-d70af571-8573-4ef5-82e8-9b30084616df" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG nova.network.neutron [req-72e31af3-4368-4b27-914a-b60da2845411 req-c39c92c0-019e-476b-bb3c-8f99ce4db6f4 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG nova.network.neutron [req-72e31af3-4368-4b27-914a-b60da2845411 req-c39c92c0-019e-476b-bb3c-8f99ce4db6f4 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-72e31af3-4368-4b27-914a-b60da2845411 req-c39c92c0-019e-476b-bb3c-8f99ce4db6f4 service nova] Releasing lock "refresh_cache-d70af571-8573-4ef5-82e8-9b30084616df" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquired lock "refresh_cache-d70af571-8573-4ef5-82e8-9b30084616df" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:18:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Updating instance_info_cache with network_info: [{"id": "2e242288-e4f1-4f5b-a894-0116273c5757", "address": "fa:16:3e:9e:05:e3", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e242288-e4", "ovs_interfaceid": "2e242288-e4f1-4f5b-a894-0116273c5757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Releasing lock "refresh_cache-d70af571-8573-4ef5-82e8-9b30084616df" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Instance network_info: |[{"id": "2e242288-e4f1-4f5b-a894-0116273c5757", "address": "fa:16:3e:9e:05:e3", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e242288-e4", "ovs_interfaceid": "2e242288-e4f1-4f5b-a894-0116273c5757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Start _get_guest_xml network_info=[{"id": "2e242288-e4f1-4f5b-a894-0116273c5757", "address": "fa:16:3e:9e:05:e3", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e242288-e4", "ovs_interfaceid": "2e242288-e4f1-4f5b-a894-0116273c5757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:18:23 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:18:23 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-864812062',display_name='tempest-VolumesActionsTest-instance-864812062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-864812062',id=18,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcd17cc193aa4827b94888db619cf93f',ramdisk_id='',reservation_id='r-0z53074z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1324925892',owner_user_name='tempest-VolumesActionsTest-1324925892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:18:21Z,user_data=None,user_id='41bade78e9b24a15ab4016dc76a20931',uuid=d70af571-8573-4ef5-82e8-9b30084616df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e242288-e4f1-4f5b-a894-0116273c5757", "address": "fa:16:3e:9e:05:e3", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e242288-e4", "ovs_interfaceid": "2e242288-e4f1-4f5b-a894-0116273c5757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converting VIF {"id": "2e242288-e4f1-4f5b-a894-0116273c5757", "address": "fa:16:3e:9e:05:e3", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e242288-e4", "ovs_interfaceid": "2e242288-e4f1-4f5b-a894-0116273c5757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:e3,bridge_name='br-int',has_traffic_filtering=True,id=2e242288-e4f1-4f5b-a894-0116273c5757,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e242288-e4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lazy-loading 'pci_devices' on Instance uuid d70af571-8573-4ef5-82e8-9b30084616df {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:18:23 user nova-compute[75017]:   <uuid>d70af571-8573-4ef5-82e8-9b30084616df</uuid>
Oct 30 09:18:23 user nova-compute[75017]:   <name>instance-00000012</name>
Oct 30 09:18:23 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:18:23 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:18:23 user nova-compute[75017]:   <metadata>
Oct 30 09:18:23 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:18:23 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:18:23 user nova-compute[75017]:       <nova:name>tempest-VolumesActionsTest-instance-864812062</nova:name>
Oct 30 09:18:23 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:18:23</nova:creationTime>
Oct 30 09:18:23 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:18:23 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:18:23 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:18:23 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:18:23 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:18:23 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:18:23 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:18:23 user nova-compute[75017]:       <nova:owner>
Oct 30 09:18:23 user nova-compute[75017]:         <nova:user uuid="41bade78e9b24a15ab4016dc76a20931">tempest-VolumesActionsTest-1324925892-project-member</nova:user>
Oct 30 09:18:23 user nova-compute[75017]:         <nova:project uuid="dcd17cc193aa4827b94888db619cf93f">tempest-VolumesActionsTest-1324925892</nova:project>
Oct 30 09:18:23 user nova-compute[75017]:       </nova:owner>
Oct 30 09:18:23 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:18:23 user nova-compute[75017]:       <nova:ports>
Oct 30 09:18:23 user nova-compute[75017]:         <nova:port uuid="2e242288-e4f1-4f5b-a894-0116273c5757">
Oct 30 09:18:23 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 09:18:23 user nova-compute[75017]:         </nova:port>
Oct 30 09:18:23 user nova-compute[75017]:       </nova:ports>
Oct 30 09:18:23 user nova-compute[75017]:     </nova:instance>
Oct 30 09:18:23 user nova-compute[75017]:   </metadata>
Oct 30 09:18:23 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:18:23 user nova-compute[75017]:     <system>
Oct 30 09:18:23 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:18:23 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:18:23 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:18:23 user nova-compute[75017]:       <entry name="serial">d70af571-8573-4ef5-82e8-9b30084616df</entry>
Oct 30 09:18:23 user nova-compute[75017]:       <entry name="uuid">d70af571-8573-4ef5-82e8-9b30084616df</entry>
Oct 30 09:18:23 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:18:23 user nova-compute[75017]:     </system>
Oct 30 09:18:23 user nova-compute[75017]:   </sysinfo>
Oct 30 09:18:23 user nova-compute[75017]:   <os>
Oct 30 09:18:23 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:18:23 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:18:23 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:18:23 user nova-compute[75017]:   </os>
Oct 30 09:18:23 user nova-compute[75017]:   <features>
Oct 30 09:18:23 user nova-compute[75017]:     <acpi/>
Oct 30 09:18:23 user nova-compute[75017]:     <apic/>
Oct 30 09:18:23 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:18:23 user nova-compute[75017]:   </features>
Oct 30 09:18:23 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:18:23 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:18:23 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:18:23 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:18:23 user nova-compute[75017]:   </clock>
Oct 30 09:18:23 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:18:23 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:18:23 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:18:23 user nova-compute[75017]:   </cpu>
Oct 30 09:18:23 user nova-compute[75017]:   <devices>
Oct 30 09:18:23 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:18:23 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:18:23 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk"/>
Oct 30 09:18:23 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:18:23 user nova-compute[75017]:     </disk>
Oct 30 09:18:23 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:18:23 user nova-compute[75017]:       <mac address="fa:16:3e:9e:05:e3"/>
Oct 30 09:18:23 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:18:23 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:18:23 user nova-compute[75017]:       <target dev="tap2e242288-e4"/>
Oct 30 09:18:23 user nova-compute[75017]:     </interface>
Oct 30 09:18:23 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:18:23 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/console.log" append="off"/>
Oct 30 09:18:23 user nova-compute[75017]:     </serial>
Oct 30 09:18:23 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:18:23 user nova-compute[75017]:     <video>
Oct 30 09:18:23 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:18:23 user nova-compute[75017]:     </video>
Oct 30 09:18:23 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:18:23 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:18:23 user nova-compute[75017]:     </rng>
Oct 30 09:18:23 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:18:23 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:18:23 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:18:23 user nova-compute[75017]:     </memballoon>
Oct 30 09:18:23 user nova-compute[75017]:   </devices>
Oct 30 09:18:23 user nova-compute[75017]: </domain>
Oct 30 09:18:23 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-864812062',display_name='tempest-VolumesActionsTest-instance-864812062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-864812062',id=18,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcd17cc193aa4827b94888db619cf93f',ramdisk_id='',reservation_id='r-0z53074z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1324925892',owner_user_name='tempest-VolumesActionsTest-1324925892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:18:21Z,user_data=None,user_id='41bade78e9b24a15ab4016dc76a20931',uuid=d70af571-8573-4ef5-82e8-9b30084616df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e242288-e4f1-4f5b-a894-0116273c5757", "address": "fa:16:3e:9e:05:e3", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e242288-e4", "ovs_interfaceid": "2e242288-e4f1-4f5b-a894-0116273c5757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converting VIF {"id": "2e242288-e4f1-4f5b-a894-0116273c5757", "address": "fa:16:3e:9e:05:e3", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e242288-e4", "ovs_interfaceid": "2e242288-e4f1-4f5b-a894-0116273c5757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:e3,bridge_name='br-int',has_traffic_filtering=True,id=2e242288-e4f1-4f5b-a894-0116273c5757,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e242288-e4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG os_vif [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:e3,bridge_name='br-int',has_traffic_filtering=True,id=2e242288-e4f1-4f5b-a894-0116273c5757,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e242288-e4') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e939cde-2d42-5c6f-bd09-b47a8b3fdbb8', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e242288-e4, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e242288-e4, col_values=(('qos', UUID('83e5895d-562e-43e5-9fb0-b6ab7c3a7389')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e242288-e4, col_values=(('external_ids', {'iface-id': '2e242288-e4f1-4f5b-a894-0116273c5757', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:05:e3', 'vm-uuid': 'd70af571-8573-4ef5-82e8-9b30084616df'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:23 user nova-compute[75017]: INFO os_vif [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:e3,bridge_name='br-int',has_traffic_filtering=True,id=2e242288-e4f1-4f5b-a894-0116273c5757,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e242288-e4')
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:18:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] No VIF found with MAC fa:16:3e:9e:05:e3, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:18:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-d97f04ac-cce6-492e-b454-2aa7c2864765 req-d0dd0b5c-21bb-4a83-a6f4-16fdf03c84b0 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received event network-vif-plugged-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d97f04ac-cce6-492e-b454-2aa7c2864765 req-d0dd0b5c-21bb-4a83-a6f4-16fdf03c84b0 service nova] Acquiring lock "d70af571-8573-4ef5-82e8-9b30084616df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d97f04ac-cce6-492e-b454-2aa7c2864765 req-d0dd0b5c-21bb-4a83-a6f4-16fdf03c84b0 service nova] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d97f04ac-cce6-492e-b454-2aa7c2864765 req-d0dd0b5c-21bb-4a83-a6f4-16fdf03c84b0 service nova] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-d97f04ac-cce6-492e-b454-2aa7c2864765 req-d0dd0b5c-21bb-4a83-a6f4-16fdf03c84b0 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] No waiting events found dispatching network-vif-plugged-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:25 user nova-compute[75017]: WARNING nova.compute.manager [req-d97f04ac-cce6-492e-b454-2aa7c2864765 req-d0dd0b5c-21bb-4a83-a6f4-16fdf03c84b0 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received unexpected event network-vif-plugged-2e242288-e4f1-4f5b-a894-0116273c5757 for instance with vm_state building and task_state spawning.
Oct 30 09:18:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-b72b2095-b07b-4281-82ba-385c05eedf58 req-b037acf8-4e00-41d2-aba2-cc576376ece2 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received event network-vif-plugged-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b72b2095-b07b-4281-82ba-385c05eedf58 req-b037acf8-4e00-41d2-aba2-cc576376ece2 service nova] Acquiring lock "d70af571-8573-4ef5-82e8-9b30084616df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b72b2095-b07b-4281-82ba-385c05eedf58 req-b037acf8-4e00-41d2-aba2-cc576376ece2 service nova] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b72b2095-b07b-4281-82ba-385c05eedf58 req-b037acf8-4e00-41d2-aba2-cc576376ece2 service nova] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-b72b2095-b07b-4281-82ba-385c05eedf58 req-b037acf8-4e00-41d2-aba2-cc576376ece2 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] No waiting events found dispatching network-vif-plugged-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:27 user nova-compute[75017]: WARNING nova.compute.manager [req-b72b2095-b07b-4281-82ba-385c05eedf58 req-b037acf8-4e00-41d2-aba2-cc576376ece2 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received unexpected event network-vif-plugged-2e242288-e4f1-4f5b-a894-0116273c5757 for instance with vm_state building and task_state spawning.
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:18:27 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Instance spawned successfully.
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:27 user nova-compute[75017]: INFO nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Took 7.09 seconds to spawn the instance on the hypervisor.
Oct 30 09:18:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:18:28 user nova-compute[75017]: INFO nova.compute.manager [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Took 8.08 seconds to build instance.
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b2715d81-1e9e-4daa-97c7-0ed997c7315e tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "d70af571-8573-4ef5-82e8-9b30084616df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.202s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:18:28 user nova-compute[75017]: INFO nova.compute.claims [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Claim successful on node user
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "5a294811-e03d-4034-871d-db6ba2ad721d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:28 user nova-compute[75017]: INFO nova.compute.manager [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Terminating instance
Oct 30 09:18:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:18:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.policy [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32be8c463bb84c4baa5c8af3900ac613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b631fb81c2fc4dc1a7ab30957279de25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:18:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Creating image(s)
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "/opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "/opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "/opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Instance destroyed successfully.
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.objects.instance [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lazy-loading 'resources' on Instance uuid 5a294811-e03d-4034-871d-db6ba2ad721d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1298966713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336386316',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK41I5D09IEItrwBGv57T/9QpZ4xvfrikmugxYqYCeOgq36dju7nfyqi8IgYaIAFEzcXXx+7C1Q8g3cHSKYsfkHntXkvMk131KHuB14YNxNDJqfZXdzIIjjyJdTTefyNRA==',key_name='tempest-keypair-1967695828',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='734c9139fffd4605a81e382a6b54a0e6',ramdisk_id='',reservation_id='r-takylgq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1641318212',owner_user_name='tempest-ServerActionsV293TestJSON-1641318212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f08150a4aa4eff90af699ccc61d4e5',uuid=5a294811-e03d-4034-871d-db6ba2ad721d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converting VIF {"id": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "address": "fa:16:3e:be:0d:f7", "network": {"id": "b32c8935-27ae-4d8e-9180-5f75936cc9fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1577248828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "734c9139fffd4605a81e382a6b54a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0710ebd4-b1", "ovs_interfaceid": "0710ebd4-b142-4fec-b28f-338eced9e4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_vif [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0710ebd4-b1, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3fbf245-6361-49ed-9bca-8f7b2040ea59) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:29 user nova-compute[75017]: INFO os_vif [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:f7,bridge_name='br-int',has_traffic_filtering=True,id=0710ebd4-b142-4fec-b28f-338eced9e4c7,network=Network(b32c8935-27ae-4d8e-9180-5f75936cc9fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0710ebd4-b1')
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoyQnSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:18:29 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee23bc80-4f6f-49aa-bd04-c5c529f3e850]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:18:29 user nova-compute[75017]: No targets found.
Oct 30 09:18:29 user nova-compute[75017]: iSNS:
Oct 30 09:18:29 user nova-compute[75017]: No targets found.
Oct 30 09:18:29 user nova-compute[75017]: STATIC:
Oct 30 09:18:29 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:18:29 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:18:29 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:18:29 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:18:29 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:18:29 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:18:29 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244
Oct 30 09:18:29 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:18:29 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:18:29 user nova-compute[75017]: FIRMWARE:
Oct 30 09:18:29 user nova-compute[75017]: No targets found.
Oct 30 09:18:29 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:18:29 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:18:29 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b18f57-6227-408d-bb46-56b89cebf961]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb76099-d49e-4931-8264-3b14a5e6f773]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:18:29 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:18:29 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:29 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 (non-flash)
Oct 30 09:18:29 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:18:29 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:29 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd855a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa05033-821a-4b41-818f-8dcdb9572bd7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0420e5-df8f-4bdb-a595-034680a7fe33]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51696cb-27f4-411a-9391-4380637060e6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab4b47d-e797-403b-9ce0-db11dfec05a4]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdf9e2379-c34b5562910f4d87', '/dev/disk/by-id/scsi-26333346235353632', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_df9e2379') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec23c9ba-f0e8-4f52-9835-630be1223701]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89899b5-f511-4914-8993-ac26d7431473]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.262s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk 1073741824" returned: 0 in 0.053s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf0d93e-7ef1-4132-b781-db0cb8647c7a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260]
Oct 30 09:18:29 user nova-compute[75017]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244, portal: 172.16.0.220,3260] successful.
Oct 30 09:18:29 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-unplugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] No waiting events found dispatching network-vif-unplugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-unplugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] Acquiring lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] Lock "5a294811-e03d-4034-871d-db6ba2ad721d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] No waiting events found dispatching network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:29 user nova-compute[75017]: WARNING nova.compute.manager [req-865925de-52bf-4e5a-b8ad-b0cbf263601e req-c6e9c623-7e5d-4220-a40a-54ed072e4144 service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received unexpected event network-vif-plugged-0710ebd4-b142-4fec-b28f-338eced9e4c7 for instance with vm_state active and task_state deleting.
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9871b3-cec4-447d-89c0-aa4d20fa3244 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8242ca4-6d3a-429d-8a59-54a4cbcab81b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] <== disconnect_volume: return (444ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:18:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Deleting instance files /opt/stack/data/nova/instances/5a294811-e03d-4034-871d-db6ba2ad721d_del
Oct 30 09:18:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Deletion of /opt/stack/data/nova/instances/5a294811-e03d-4034-871d-db6ba2ad721d_del complete
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Successfully created port: 6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:18:29 user nova-compute[75017]: INFO nova.compute.manager [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.210s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:18:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Cannot resize image /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Ensure instance console log exists: /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Successfully updated port: 6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquired lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-b4fed098-0d71-4699-b5c1-e2c99a121e4b req-910c1965-0cfd-47f8-955d-bca8d2cc2e3f service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-changed-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-b4fed098-0d71-4699-b5c1-e2c99a121e4b req-910c1965-0cfd-47f8-955d-bca8d2cc2e3f service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Refreshing instance network info cache due to event network-changed-6eb5467b-29cc-4ead-87d9-46828d9a797b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4fed098-0d71-4699-b5c1-e2c99a121e4b req-910c1965-0cfd-47f8-955d-bca8d2cc2e3f service nova] Acquiring lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:18:30 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:18:31 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Took 1.13 seconds to deallocate network for instance.
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance_info_cache with network_info: [{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-2f37ddba-f0eb-4e5f-ac4f-acf9d86d2492 req-ff7edb21-e74b-42ec-aee1-249e2b59737a service nova] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Received event network-vif-deleted-0710ebd4-b142-4fec-b28f-338eced9e4c7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Releasing lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance network_info: |[{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4fed098-0d71-4699-b5c1-e2c99a121e4b req-910c1965-0cfd-47f8-955d-bca8d2cc2e3f service nova] Acquired lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-b4fed098-0d71-4699-b5c1-e2c99a121e4b req-910c1965-0cfd-47f8-955d-bca8d2cc2e3f service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Refreshing network info cache for port 6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Start _get_guest_xml network_info=[{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:18:31 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:18:31 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-605656703',display_name='tempest-ServerActionsTestOtherB-server-605656703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-605656703',id=19,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsO3D8imqXadqbsvenS1ZFOBMwiMnHotDuidmowiAb2AKB1yeka44kaMsm8Bk0/3S4Tx29wUyIzxAdVbBUzhcdNcjZWvbYuXl0341auprHHVWRadGKrbSxoWPFvfh13Q==',key_name='tempest-keypair-1868016218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b631fb81c2fc4dc1a7ab30957279de25',ramdisk_id='',reservation_id='r-edgijgvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-794901056',owner_user_name='tempest-ServerActionsTestOtherB-794901056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32be8c463bb84c4baa5c8af3900ac613',uuid=28c7433c-4edd-4d5b-8d9c-68308998a508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converting VIF {"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lazy-loading 'pci_devices' on Instance uuid 28c7433c-4edd-4d5b-8d9c-68308998a508 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:18:31 user nova-compute[75017]:   <uuid>28c7433c-4edd-4d5b-8d9c-68308998a508</uuid>
Oct 30 09:18:31 user nova-compute[75017]:   <name>instance-00000013</name>
Oct 30 09:18:31 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:18:31 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:18:31 user nova-compute[75017]:   <metadata>
Oct 30 09:18:31 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:18:31 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:18:31 user nova-compute[75017]:       <nova:name>tempest-ServerActionsTestOtherB-server-605656703</nova:name>
Oct 30 09:18:31 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:18:31</nova:creationTime>
Oct 30 09:18:31 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:18:31 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:18:31 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:18:31 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:18:31 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:18:31 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:18:31 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:18:31 user nova-compute[75017]:       <nova:owner>
Oct 30 09:18:31 user nova-compute[75017]:         <nova:user uuid="32be8c463bb84c4baa5c8af3900ac613">tempest-ServerActionsTestOtherB-794901056-project-member</nova:user>
Oct 30 09:18:31 user nova-compute[75017]:         <nova:project uuid="b631fb81c2fc4dc1a7ab30957279de25">tempest-ServerActionsTestOtherB-794901056</nova:project>
Oct 30 09:18:31 user nova-compute[75017]:       </nova:owner>
Oct 30 09:18:31 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:18:31 user nova-compute[75017]:       <nova:ports>
Oct 30 09:18:31 user nova-compute[75017]:         <nova:port uuid="6eb5467b-29cc-4ead-87d9-46828d9a797b">
Oct 30 09:18:31 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 09:18:31 user nova-compute[75017]:         </nova:port>
Oct 30 09:18:31 user nova-compute[75017]:       </nova:ports>
Oct 30 09:18:31 user nova-compute[75017]:     </nova:instance>
Oct 30 09:18:31 user nova-compute[75017]:   </metadata>
Oct 30 09:18:31 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:18:31 user nova-compute[75017]:     <system>
Oct 30 09:18:31 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:18:31 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:18:31 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:18:31 user nova-compute[75017]:       <entry name="serial">28c7433c-4edd-4d5b-8d9c-68308998a508</entry>
Oct 30 09:18:31 user nova-compute[75017]:       <entry name="uuid">28c7433c-4edd-4d5b-8d9c-68308998a508</entry>
Oct 30 09:18:31 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:18:31 user nova-compute[75017]:     </system>
Oct 30 09:18:31 user nova-compute[75017]:   </sysinfo>
Oct 30 09:18:31 user nova-compute[75017]:   <os>
Oct 30 09:18:31 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:18:31 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:18:31 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:18:31 user nova-compute[75017]:   </os>
Oct 30 09:18:31 user nova-compute[75017]:   <features>
Oct 30 09:18:31 user nova-compute[75017]:     <acpi/>
Oct 30 09:18:31 user nova-compute[75017]:     <apic/>
Oct 30 09:18:31 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:18:31 user nova-compute[75017]:   </features>
Oct 30 09:18:31 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:18:31 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:18:31 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:18:31 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:18:31 user nova-compute[75017]:   </clock>
Oct 30 09:18:31 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:18:31 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:18:31 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:18:31 user nova-compute[75017]:   </cpu>
Oct 30 09:18:31 user nova-compute[75017]:   <devices>
Oct 30 09:18:31 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:18:31 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:18:31 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk"/>
Oct 30 09:18:31 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:18:31 user nova-compute[75017]:     </disk>
Oct 30 09:18:31 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:18:31 user nova-compute[75017]:       <mac address="fa:16:3e:7b:86:de"/>
Oct 30 09:18:31 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:18:31 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:18:31 user nova-compute[75017]:       <target dev="tap6eb5467b-29"/>
Oct 30 09:18:31 user nova-compute[75017]:     </interface>
Oct 30 09:18:31 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:18:31 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/console.log" append="off"/>
Oct 30 09:18:31 user nova-compute[75017]:     </serial>
Oct 30 09:18:31 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:18:31 user nova-compute[75017]:     <video>
Oct 30 09:18:31 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:18:31 user nova-compute[75017]:     </video>
Oct 30 09:18:31 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:18:31 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:18:31 user nova-compute[75017]:     </rng>
Oct 30 09:18:31 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:18:31 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:18:31 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:18:31 user nova-compute[75017]:     </memballoon>
Oct 30 09:18:31 user nova-compute[75017]:   </devices>
Oct 30 09:18:31 user nova-compute[75017]: </domain>
Oct 30 09:18:31 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-605656703',display_name='tempest-ServerActionsTestOtherB-server-605656703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-605656703',id=19,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsO3D8imqXadqbsvenS1ZFOBMwiMnHotDuidmowiAb2AKB1yeka44kaMsm8Bk0/3S4Tx29wUyIzxAdVbBUzhcdNcjZWvbYuXl0341auprHHVWRadGKrbSxoWPFvfh13Q==',key_name='tempest-keypair-1868016218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b631fb81c2fc4dc1a7ab30957279de25',ramdisk_id='',reservation_id='r-edgijgvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-794901056',owner_user_name='tempest-ServerActionsTestOtherB-794901056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32be8c463bb84c4baa5c8af3900ac613',uuid=28c7433c-4edd-4d5b-8d9c-68308998a508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converting VIF {"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG os_vif [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ed303ac-fc9f-58b9-b08c-23d5f1157205', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eb5467b-29, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6eb5467b-29, col_values=(('qos', UUID('bdf848c9-4062-4fe3-a586-85566249f4e3')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6eb5467b-29, col_values=(('external_ids', {'iface-id': '6eb5467b-29cc-4ead-87d9-46828d9a797b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:86:de', 'vm-uuid': '28c7433c-4edd-4d5b-8d9c-68308998a508'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:31 user nova-compute[75017]: INFO os_vif [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29')
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] No VIF found with MAC fa:16:3e:7b:86:de, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-b4fed098-0d71-4699-b5c1-e2c99a121e4b req-910c1965-0cfd-47f8-955d-bca8d2cc2e3f service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updated VIF entry in instance network info cache for port 6eb5467b-29cc-4ead-87d9-46828d9a797b. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-b4fed098-0d71-4699-b5c1-e2c99a121e4b req-910c1965-0cfd-47f8-955d-bca8d2cc2e3f service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance_info_cache with network_info: [{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:18:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4fed098-0d71-4699-b5c1-e2c99a121e4b req-910c1965-0cfd-47f8-955d-bca8d2cc2e3f service nova] Releasing lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:18:32 user nova-compute[75017]: INFO nova.compute.manager [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Took 1.07 seconds to detach 1 volumes for instance.
Oct 30 09:18:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] [instance: 5a294811-e03d-4034-871d-db6ba2ad721d] Deleting volume: 3a9871b3-cec4-447d-89c0-aa4d20fa3244 {{(pid=75017) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.628s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sItbzUMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:18:32 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:18:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:18:32 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:18:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:18:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:18:32 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:18:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:32 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Deleted allocations for instance 5a294811-e03d-4034-871d-db6ba2ad721d
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2cbb5d-0b86-4ed2-9fc5-832445cecc57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:18:33 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b0c091-c111-4fee-be40-4e0409c2de87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14] added
Oct 30 09:18:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abd95ec-a9ae-4291-af16-eb2d077d4161]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a49e93-df97-48d2-a57c-4500e41f0e8d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sItbzUMi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a09f832-254e-4194-a360-ab3a2f2d9a5e tempest-ServerActionsV293TestJSON-1641318212 tempest-ServerActionsV293TestJSON-1641318212-project-member] Lock "5a294811-e03d-4034-871d-db6ba2ad721d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.664s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sItbzUMi" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff3b30a-0607-4cc4-ae3e-30c4ca733ce0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sItbzUMi'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8243866-b0a3-4348-9f10-6c632944db5f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d46e94f6-465d-4112-868e-acf8cea4f402 is timed out.
Oct 30 09:18:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-46999ff2-850e-44bf-aac8-227a22801348 req-44c59c01-b45b-4483-bf6e-ba38a6737a62 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-46999ff2-850e-44bf-aac8-227a22801348 req-44c59c01-b45b-4483-bf6e-ba38a6737a62 service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-46999ff2-850e-44bf-aac8-227a22801348 req-44c59c01-b45b-4483-bf6e-ba38a6737a62 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-46999ff2-850e-44bf-aac8-227a22801348 req-44c59c01-b45b-4483-bf6e-ba38a6737a62 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-46999ff2-850e-44bf-aac8-227a22801348 req-44c59c01-b45b-4483-bf6e-ba38a6737a62 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:33 user nova-compute[75017]: WARNING nova.compute.manager [req-46999ff2-850e-44bf-aac8-227a22801348 req-44c59c01-b45b-4483-bf6e-ba38a6737a62 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state building and task_state spawning.
Oct 30 09:18:33 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully detached device vdb from instance d46e94f6-465d-4112-868e-acf8cea4f402 from the live domain config.
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[96214f5d-3ddf-4a99-9096-ab3a194f0f02]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:18:33 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:18:33 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vybCzndg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:18:33 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aef362-626d-4372-8de8-21827f439d49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260]
Oct 30 09:18:33 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260] successful.
Oct 30 09:18:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6df5a1-2a4e-4e66-a8bc-99b9f27f74e6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e447f3a9-4e2b-4fbf-b917-3cc22303ddb8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:18:33 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:18:33 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:18:33 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:18:33 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4e2d2c-4ec4-47fd-8b8d-ecfd9456437a]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sItbzUMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.520s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] <== connect_volume: return (1524ms) {'type': 'block', 'scsi_wwn': '26338306563363866', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338306563363866', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.214s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lazy-loading 'flavor' on Instance uuid 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaaa8fd-9213-4153-8cf7-42ae0ff6afd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:18:34 user nova-compute[75017]: No targets found.
Oct 30 09:18:34 user nova-compute[75017]: iSNS:
Oct 30 09:18:34 user nova-compute[75017]: No targets found.
Oct 30 09:18:34 user nova-compute[75017]: STATIC:
Oct 30 09:18:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14
Oct 30 09:18:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:18:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:18:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:18:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:18:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:18:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339
Oct 30 09:18:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:18:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:18:34 user nova-compute[75017]: FIRMWARE:
Oct 30 09:18:34 user nova-compute[75017]: No targets found.
Oct 30 09:18:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:18:34 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:18:34 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:18:34 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:18:34 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:18:34 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:18:34 user nova-compute[75017]:   <serial>76578c94-dbfd-4ae7-a51e-d1113879fc14</serial>
Oct 30 09:18:34 user nova-compute[75017]: </disk>
Oct 30 09:18:34 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f3053d-f038-4578-807a-99cd4f18788a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f449e05-43e3-4c7a-8d14-18a5dcae9bb0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:18:34 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:18:34 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:18:34 user nova-compute[75017]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 (non-flash)
Oct 30 09:18:34 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccdcfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339'): ({'sdd'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Removing single pathed devices sdd {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e241a34-e14c-4ad3-a8d7-6acd0f346f95]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7a9cb9-9e54-41f2-ba5d-10be5d9cf206]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flushing IO for device /dev/sdd {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ed8f2f-e6f8-4051-85bd-acbb2dc289e6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4fcf16-dfb6-4b76-af89-4bed46ad1967]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ce892-7253-4e72-a76c-ef45a89f322a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[613e6d39-fa61-475f-bbf6-12bbbe749008]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339, portal: 172.16.0.220,3260]
Oct 30 09:18:34 user nova-compute[75017]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339, portal: 172.16.0.220,3260] successful.
Oct 30 09:18:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdb7bf0-270f-433e-b323-88c35d27d339 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f82a08-9199-4eb6-a9b2-84500f0700d1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] <== disconnect_volume: return (1612ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:18:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No VIF found with MAC fa:16:3e:7d:00:b5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5b8a2052-2466-416f-b126-c1378973e6d1 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.280s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-12f54a3f-f95a-4f0e-a812-c03e3caad690 req-5bb5f542-b8fa-491d-ae5c-32080c9e9494 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-12f54a3f-f95a-4f0e-a812-c03e3caad690 req-5bb5f542-b8fa-491d-ae5c-32080c9e9494 service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-12f54a3f-f95a-4f0e-a812-c03e3caad690 req-5bb5f542-b8fa-491d-ae5c-32080c9e9494 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-12f54a3f-f95a-4f0e-a812-c03e3caad690 req-5bb5f542-b8fa-491d-ae5c-32080c9e9494 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-12f54a3f-f95a-4f0e-a812-c03e3caad690 req-5bb5f542-b8fa-491d-ae5c-32080c9e9494 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:35 user nova-compute[75017]: WARNING nova.compute.manager [req-12f54a3f-f95a-4f0e-a812-c03e3caad690 req-5bb5f542-b8fa-491d-ae5c-32080c9e9494 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state building and task_state spawning.
Oct 30 09:18:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:18:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance spawned successfully.
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:18:35 user nova-compute[75017]: INFO nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Took 6.39 seconds to spawn the instance on the hypervisor.
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:18:35 user nova-compute[75017]: INFO nova.compute.manager [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Took 7.48 seconds to build instance.
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9b92967-e3c9-4831-a9f4-5c605e4487b1 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.603s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid d46e94f6-465d-4112-868e-acf8cea4f402 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 35e56f63-7e8b-4324-b16c-b4fac5bb0087 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid df215875-673c-4446-afa1-3446ff63edbd {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 301352c4-d76d-4564-af67-0cafdc6c893b {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid d70af571-8573-4ef5-82e8-9b30084616df {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 28c7433c-4edd-4d5b-8d9c-68308998a508 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "df215875-673c-4446-afa1-3446ff63edbd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "c6aae433-005c-4b50-9006-d71bca0f8368" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "301352c4-d76d-4564-af67-0cafdc6c893b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "301352c4-d76d-4564-af67-0cafdc6c893b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "3833002b-0acf-4093-8f10-097760487c73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "d70af571-8573-4ef5-82e8-9b30084616df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "d70af571-8573-4ef5-82e8-9b30084616df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "df215875-673c-4446-afa1-3446ff63edbd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "d70af571-8573-4ef5-82e8-9b30084616df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.153s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "3833002b-0acf-4093-8f10-097760487c73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.153s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "c6aae433-005c-4b50-9006-d71bca0f8368" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.179s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "301352c4-d76d-4564-af67-0cafdc6c893b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.200s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:36 user nova-compute[75017]: INFO nova.compute.manager [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Rebuilding instance
Oct 30 09:18:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:18:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-fef47be7-8613-425e-bc10-f6b39910b663 req-f8dbd965-97f4-4402-99b7-5c5dba1128dd service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received event network-vif-unplugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fef47be7-8613-425e-bc10-f6b39910b663 req-f8dbd965-97f4-4402-99b7-5c5dba1128dd service nova] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fef47be7-8613-425e-bc10-f6b39910b663 req-f8dbd965-97f4-4402-99b7-5c5dba1128dd service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fef47be7-8613-425e-bc10-f6b39910b663 req-f8dbd965-97f4-4402-99b7-5c5dba1128dd service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-fef47be7-8613-425e-bc10-f6b39910b663 req-f8dbd965-97f4-4402-99b7-5c5dba1128dd service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] No waiting events found dispatching network-vif-unplugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:37 user nova-compute[75017]: WARNING nova.compute.manager [req-fef47be7-8613-425e-bc10-f6b39910b663 req-f8dbd965-97f4-4402-99b7-5c5dba1128dd service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received unexpected event network-vif-unplugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf for instance with vm_state active and task_state rebuilding.
Oct 30 09:18:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Instance destroyed successfully.
Oct 30 09:18:38 user nova-compute[75017]: INFO nova.compute.manager [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Detaching volume 76578c94-dbfd-4ae7-a51e-d1113879fc14
Oct 30 09:18:38 user nova-compute[75017]: INFO nova.virt.block_device [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Attempting to driver detach volume 76578c94-dbfd-4ae7-a51e-d1113879fc14 from mountpoint /dev/vdb
Oct 30 09:18:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Attempting to detach device vdb from instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:18:38 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:18:38 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:18:38 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:18:38 user nova-compute[75017]:   <serial>76578c94-dbfd-4ae7-a51e-d1113879fc14</serial>
Oct 30 09:18:38 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:18:38 user nova-compute[75017]: </disk>
Oct 30 09:18:38 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:18:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully detached device vdb from instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 from the persistent domain config.
Oct 30 09:18:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sItbzUMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:18:38 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0cb9a-6f73-4093-ae02-c16eea481b18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:18:38 user nova-compute[75017]: No targets found.
Oct 30 09:18:38 user nova-compute[75017]: iSNS:
Oct 30 09:18:38 user nova-compute[75017]: No targets found.
Oct 30 09:18:38 user nova-compute[75017]: STATIC:
Oct 30 09:18:38 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14
Oct 30 09:18:38 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:18:38 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:18:38 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:18:38 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:18:38 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:18:38 user nova-compute[75017]: FIRMWARE:
Oct 30 09:18:38 user nova-compute[75017]: No targets found.
Oct 30 09:18:38 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:18:38 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:18:38 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8723b327-89be-483e-b682-8bbd7b21bfd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[69946535-9709-4126-916e-36ef6836163d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:18:38 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:38 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:18:38 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:38 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd91750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1f85b3-238c-40a0-9741-6495ab7da768]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69d9e34-f81b-449c-b8fa-64095a9adcd7]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4882de-c746-4169-a721-a756edb5d529]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cc85a6-f27a-426a-a43d-9106fe2296df]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a814e2-7cef-40d4-86db-213c549c91fe]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d268d0-0d48-469e-a92c-751a149f1d8a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260]
Oct 30 09:18:38 user nova-compute[75017]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260] successful.
Oct 30 09:18:38 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ad9841-ab38-4243-84fa-57589493952b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] <== disconnect_volume: return (388ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:18:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-a642f134-d4cb-4548-b60e-7b5cc1766852 req-9c7600c9-b4c4-4c0c-98ff-234ca7c2f35e service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a642f134-d4cb-4548-b60e-7b5cc1766852 req-9c7600c9-b4c4-4c0c-98ff-234ca7c2f35e service nova] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a642f134-d4cb-4548-b60e-7b5cc1766852 req-9c7600c9-b4c4-4c0c-98ff-234ca7c2f35e service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a642f134-d4cb-4548-b60e-7b5cc1766852 req-9c7600c9-b4c4-4c0c-98ff-234ca7c2f35e service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-a642f134-d4cb-4548-b60e-7b5cc1766852 req-9c7600c9-b4c4-4c0c-98ff-234ca7c2f35e service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] No waiting events found dispatching network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:39 user nova-compute[75017]: WARNING nova.compute.manager [req-a642f134-d4cb-4548-b60e-7b5cc1766852 req-9c7600c9-b4c4-4c0c-98ff-234ca7c2f35e service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received unexpected event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf for instance with vm_state active and task_state rebuilding.
Oct 30 09:18:39 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Instance destroyed successfully.
Oct 30 09:18:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1576787538',display_name='tempest-ServerActionsTestOtherA-server-562515772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1576787538',id=14,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ0D6pPliPvw56NeAbr78L4cM6urRqlbH/HwVTIC+dhKSceCfYhmC9ZsFcU6onZI0QNuc+Jo53dGW/cYd6EH1dN5NBpAtDlqFj9M8umKfz8L6hmG4gKRGk7vkrHTwKdKg==',key_name='tempest-keypair-717482653',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-39dtqb84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=75bb6699-a0c6-4f04-9fca-b0c20b6c0162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_vif [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c6c6da9-86, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bb18499-dbe0-467b-8ecd-17eedb3e0301) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:39 user nova-compute[75017]: INFO os_vif [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86')
Oct 30 09:18:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sItbzUMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:18:39 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a35d0c9-0568-42aa-a7b6-45c460750966]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:18:39 user nova-compute[75017]: No targets found.
Oct 30 09:18:39 user nova-compute[75017]: iSNS:
Oct 30 09:18:39 user nova-compute[75017]: No targets found.
Oct 30 09:18:39 user nova-compute[75017]: STATIC:
Oct 30 09:18:39 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:18:39 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:18:39 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:18:39 user nova-compute[75017]: FIRMWARE:
Oct 30 09:18:39 user nova-compute[75017]: No targets found.
Oct 30 09:18:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:18:39 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:18:39 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1123589f-6411-414a-858a-16e93fa878f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[519a397c-33ef-4257-8b82-4d8b2a570002]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:18:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccdb2050>, {}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Disconnecting from: [] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] <== disconnect_volume: return (90ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:18:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:18:39 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Deleting instance files /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162_del
Oct 30 09:18:39 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Deletion of /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162_del complete
Oct 30 09:18:40 user nova-compute[75017]: INFO nova.virt.block_device [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Booting with volume 76578c94-dbfd-4ae7-a51e-d1113879fc14 at /dev/vdb
Oct 30 09:18:40 user nova-compute[75017]: DEBUG os_brick.utils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b63d17-0412-4ae6-8bdf-31bcc41d8a33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc55284-849b-4ba5-849a-23df84a05a52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7a419e-764b-40a6-8ea1-8012ec131f4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[05feb4fb-2211-46db-84e5-7b9b317056a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:18:40 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:18:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e317092d-c815-46e5-87ad-ee1e936a8967]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG os_brick.utils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:18:40 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Updating existing volume attachment record: 673b4c9b-a9af-40e9-8ff3-fd5945b1450c {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:18:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "301352c4-d76d-4564-af67-0cafdc6c893b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "301352c4-d76d-4564-af67-0cafdc6c893b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:46 user nova-compute[75017]: INFO nova.compute.manager [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Terminating instance
Oct 30 09:18:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'flavor' on Instance uuid d46e94f6-465d-4112-868e-acf8cea4f402 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-601e769c-917c-4c76-8dfc-15ebc435afc1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.221s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.681s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-20252b8f-fe32-40d2-9480-2b2dd7f74197 req-7f4756d7-88dd-4b36-930e-df3bf86da04e service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received event network-vif-unplugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-20252b8f-fe32-40d2-9480-2b2dd7f74197 req-7f4756d7-88dd-4b36-930e-df3bf86da04e service nova] Acquiring lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-20252b8f-fe32-40d2-9480-2b2dd7f74197 req-7f4756d7-88dd-4b36-930e-df3bf86da04e service nova] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-20252b8f-fe32-40d2-9480-2b2dd7f74197 req-7f4756d7-88dd-4b36-930e-df3bf86da04e service nova] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-20252b8f-fe32-40d2-9480-2b2dd7f74197 req-7f4756d7-88dd-4b36-930e-df3bf86da04e service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] No waiting events found dispatching network-vif-unplugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-20252b8f-fe32-40d2-9480-2b2dd7f74197 req-7f4756d7-88dd-4b36-930e-df3bf86da04e service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received event network-vif-unplugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:18:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Instance destroyed successfully.
Oct 30 09:18:47 user nova-compute[75017]: DEBUG nova.objects.instance [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lazy-loading 'resources' on Instance uuid 301352c4-d76d-4564-af67-0cafdc6c893b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2120330198',display_name='tempest-VolumesAdminNegativeTest-server-2120330198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2120330198',id=16,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70c6be03e11b42249f25e6a80223f16f',ramdisk_id='',reservation_id='r-4pe5aqn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-790420406',owner_user_name='tempest-VolumesAdminNegativeTest-790420406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:16:43Z,user_data=None,user_id='70705b579acb43ef8420b6fa57c64e12',uuid=301352c4-d76d-4564-af67-0cafdc6c893b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converting VIF {"id": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "address": "fa:16:3e:61:d6:d5", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097ac0ad-bd", "ovs_interfaceid": "097ac0ad-bda4-4b58-a21e-133fe77f76ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=097ac0ad-bda4-4b58-a21e-133fe77f76ca,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097ac0ad-bd') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG os_vif [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=097ac0ad-bda4-4b58-a21e-133fe77f76ca,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097ac0ad-bd') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap097ac0ad-bd, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08fd7ec3-c1be-4725-9336-6366d03684e9) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:18:47 user nova-compute[75017]: INFO os_vif [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=097ac0ad-bda4-4b58-a21e-133fe77f76ca,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097ac0ad-bd')
Oct 30 09:18:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Deleting instance files /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b_del
Oct 30 09:18:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Deletion of /opt/stack/data/nova/instances/301352c4-d76d-4564-af67-0cafdc6c893b_del complete
Oct 30 09:18:47 user nova-compute[75017]: INFO nova.compute.manager [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 30 09:18:47 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:18:47 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:18:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-d2606ae8-4688-4940-b944-5cd48b55fea9 req-f0f1a38c-c719-458a-83eb-a6523a83dd00 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received event network-vif-deleted-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:48 user nova-compute[75017]: INFO nova.compute.manager [req-d2606ae8-4688-4940-b944-5cd48b55fea9 req-f0f1a38c-c719-458a-83eb-a6523a83dd00 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Neutron deleted interface 097ac0ad-bda4-4b58-a21e-133fe77f76ca; detaching it from the instance and deleting it from the info cache
Oct 30 09:18:48 user nova-compute[75017]: DEBUG nova.network.neutron [req-d2606ae8-4688-4940-b944-5cd48b55fea9 req-f0f1a38c-c719-458a-83eb-a6523a83dd00 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:18:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-d2606ae8-4688-4940-b944-5cd48b55fea9 req-f0f1a38c-c719-458a-83eb-a6523a83dd00 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Detach interface failed, port_id=097ac0ad-bda4-4b58-a21e-133fe77f76ca, reason: Instance 301352c4-d76d-4564-af67-0cafdc6c893b could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:18:48 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:18:48 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Took 0.74 seconds to deallocate network for instance.
Oct 30 09:18:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:48 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:18:48 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:18:48 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:18:48 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:18:48 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:18:49 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:18:49 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:18:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-8dfcb26e-3030-463b-9661-1cfb859958ad req-7f280f6c-0308-4e01-9281-549439211cf6 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received event network-vif-plugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:18:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8dfcb26e-3030-463b-9661-1cfb859958ad req-7f280f6c-0308-4e01-9281-549439211cf6 service nova] Acquiring lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:18:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8dfcb26e-3030-463b-9661-1cfb859958ad req-7f280f6c-0308-4e01-9281-549439211cf6 service nova] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:18:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8dfcb26e-3030-463b-9661-1cfb859958ad req-7f280f6c-0308-4e01-9281-549439211cf6 service nova] Lock "301352c4-d76d-4564-af67-0cafdc6c893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-8dfcb26e-3030-463b-9661-1cfb859958ad req-7f280f6c-0308-4e01-9281-549439211cf6 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] No waiting events found dispatching network-vif-plugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:18:49 user nova-compute[75017]: WARNING nova.compute.manager [req-8dfcb26e-3030-463b-9661-1cfb859958ad req-7f280f6c-0308-4e01-9281-549439211cf6 service nova] [instance: 301352c4-d76d-4564-af67-0cafdc6c893b] Received unexpected event network-vif-plugged-097ac0ad-bda4-4b58-a21e-133fe77f76ca for instance with vm_state deleted and task_state None.
Oct 30 09:18:49 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Deleted allocations for instance 301352c4-d76d-4564-af67-0cafdc6c893b
Oct 30 09:18:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-993c9b21-8d4f-4a0f-9381-a3f334b2797d tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "301352c4-d76d-4564-af67-0cafdc6c893b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.754s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:18:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:18:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:19:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Creating image(s)
Oct 30 09:19:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk 1073741824" returned: 0 in 0.057s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Cannot resize image /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Ensure instance console log exists: /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Start _get_guest_xml network_info=[{"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sItbzUMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75bb6699-a0c6-4f04-9fca-b0c20b6c0162', 'attached_at': '', 'detached_at': '', 'volume_id': '76578c94-dbfd-4ae7-a51e-d1113879fc14', 'serial': '76578c94-dbfd-4ae7-a51e-d1113879fc14'}, 'disk_bus': 'virtio', 'attachment_id': '673b4c9b-a9af-40e9-8ff3-fd5945b1450c', 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:19:02 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 09:19:02 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lazy-loading 'vcpu_model' on Instance uuid 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sItbzUMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:19:02 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:19:02 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:19:02 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd9141b-24f9-4abc-b7ea-4e205cf1cf1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:19:02 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b826c3-bee6-40e2-be4d-9617825f3141]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14] added
Oct 30 09:19:02 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af6c347-a57e-4c7c-a7df-b606f7a21275]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca840b-6277-4fc8-beac-c0e17105e0c9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sItbzUMi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:02 user nova-compute[75017]: INFO nova.compute.manager [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Terminating instance
Oct 30 09:19:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sItbzUMi" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[309afdd1-1f72-4cdb-a97a-cd59a55428c5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sItbzUMi'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e572d-45f4-4154-9e93-6b43f3989a90]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e456184c-3b58-4e04-b53c-5898ea9c61c6]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:19:02 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:19:02 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cf12bf-f739-4eef-ad52-9482b7d39066]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260]
Oct 30 09:19:03 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260] successful.
Oct 30 09:19:03 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc634319-26a3-4332-bd1f-38133eaa5e5d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4d8883-e073-46fd-be94-e23a0290cb23]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:19:03 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:19:03 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:19:03 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:19:03 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24e8d69-276f-4104-bd87-9d6dfd9298ca]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sItbzUMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e4d6cb2-e8e0-40f6-9ece-d40b2249cf10 req-dae2d38d-0cb7-49ac-a81a-7db40ff2979c service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received event network-vif-unplugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e4d6cb2-e8e0-40f6-9ece-d40b2249cf10 req-dae2d38d-0cb7-49ac-a81a-7db40ff2979c service nova] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e4d6cb2-e8e0-40f6-9ece-d40b2249cf10 req-dae2d38d-0cb7-49ac-a81a-7db40ff2979c service nova] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e4d6cb2-e8e0-40f6-9ece-d40b2249cf10 req-dae2d38d-0cb7-49ac-a81a-7db40ff2979c service nova] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e4d6cb2-e8e0-40f6-9ece-d40b2249cf10 req-dae2d38d-0cb7-49ac-a81a-7db40ff2979c service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] No waiting events found dispatching network-vif-unplugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e4d6cb2-e8e0-40f6-9ece-d40b2249cf10 req-dae2d38d-0cb7-49ac-a81a-7db40ff2979c service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received event network-vif-unplugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:19:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Instance destroyed successfully.
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'resources' on Instance uuid d46e94f6-465d-4112-868e-acf8cea4f402 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-13442871',display_name='tempest-AttachVolumeNegativeTest-server-13442871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-13442871',id=2,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaBcNhxje2Oe7fvibCzJy2iyKBuqlN1rli6OhXKFDyJ5Yvc4rnmJImr4MEXarG0i1UBXEN8cpqceIsJHxOin/B0HjIbOmO3jz1EHyyrDXLIjDrHV3CElL7zwrkupJ0v4A==',key_name='tempest-keypair-501313045',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:12:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-vbr7v7vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=d46e94f6-465d-4112-868e-acf8cea4f402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "address": "fa:16:3e:c0:ef:8b", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834b1d2f-e0", "ovs_interfaceid": "834b1d2f-e0bb-4ba4-a21d-126b54f6f432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=834b1d2f-e0bb-4ba4-a21d-126b54f6f432,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834b1d2f-e0') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG os_vif [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=834b1d2f-e0bb-4ba4-a21d-126b54f6f432,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834b1d2f-e0') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap834b1d2f-e0, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53696b71-9825-4604-a5ad-9b3142c44a6b) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:03 user nova-compute[75017]: INFO os_vif [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=834b1d2f-e0bb-4ba4-a21d-126b54f6f432,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834b1d2f-e0')
Oct 30 09:19:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Deleting instance files /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402_del
Oct 30 09:19:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Deletion of /opt/stack/data/nova/instances/d46e94f6-465d-4112-868e-acf8cea4f402_del complete
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:03 user nova-compute[75017]: INFO nova.compute.manager [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 30 09:19:03 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:19:03 user nova-compute[75017]: INFO nova.compute.manager [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Detaching volume 44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:19:03 user nova-compute[75017]: INFO nova.virt.block_device [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Attempting to driver detach volume 44f7087a-5183-4876-8f2b-e1f87b452c3d from mountpoint /dev/vdb
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Attempting to detach device vdb from instance df215875-673c-4446-afa1-3446ff63edbd from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:19:03 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:19:03 user nova-compute[75017]:   <source dev="/dev/sdf"/>
Oct 30 09:19:03 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:19:03 user nova-compute[75017]:   <serial>44f7087a-5183-4876-8f2b-e1f87b452c3d</serial>
Oct 30 09:19:03 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:19:03 user nova-compute[75017]: </disk>
Oct 30 09:19:03 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:19:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Successfully detached device vdb from instance df215875-673c-4446-afa1-3446ff63edbd from the persistent domain config.
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df215875-673c-4446-afa1-3446ff63edbd from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:19:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:19:03 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:19:03 user nova-compute[75017]:   <source dev="/dev/sdf"/>
Oct 30 09:19:03 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:19:03 user nova-compute[75017]:   <serial>44f7087a-5183-4876-8f2b-e1f87b452c3d</serial>
Oct 30 09:19:03 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:19:03 user nova-compute[75017]: </disk>
Oct 30 09:19:03 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26338306563363866', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338306563363866', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1576787538',display_name='tempest-ServerActionsTestOtherA-server-562515772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1576787538',id=14,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ0D6pPliPvw56NeAbr78L4cM6urRqlbH/HwVTIC+dhKSceCfYhmC9ZsFcU6onZI0QNuc+Jo53dGW/cYd6EH1dN5NBpAtDlqFj9M8umKfz8L6hmG4gKRGk7vkrHTwKdKg==',key_name='tempest-keypair-717482653',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-39dtqb84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=75bb6699-a0c6-4f04-9fca-b0c20b6c0162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:19:04 user nova-compute[75017]:   <uuid>75bb6699-a0c6-4f04-9fca-b0c20b6c0162</uuid>
Oct 30 09:19:04 user nova-compute[75017]:   <name>instance-0000000e</name>
Oct 30 09:19:04 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:19:04 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:19:04 user nova-compute[75017]:   <metadata>
Oct 30 09:19:04 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:19:04 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:19:04 user nova-compute[75017]:       <nova:name>tempest-ServerActionsTestOtherA-server-562515772</nova:name>
Oct 30 09:19:04 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:19:02</nova:creationTime>
Oct 30 09:19:04 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:19:04 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:19:04 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:19:04 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:19:04 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:19:04 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:19:04 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:19:04 user nova-compute[75017]:       <nova:owner>
Oct 30 09:19:04 user nova-compute[75017]:         <nova:user uuid="257ef30aa08d49a387932c340a8589c5">tempest-ServerActionsTestOtherA-1280782381-project-member</nova:user>
Oct 30 09:19:04 user nova-compute[75017]:         <nova:project uuid="f20765fc27454d25a1f53e540a8cb4fc">tempest-ServerActionsTestOtherA-1280782381</nova:project>
Oct 30 09:19:04 user nova-compute[75017]:       </nova:owner>
Oct 30 09:19:04 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:19:04 user nova-compute[75017]:       <nova:ports>
Oct 30 09:19:04 user nova-compute[75017]:         <nova:port uuid="8c6c6da9-86d9-442f-905d-7f96f9dc53cf">
Oct 30 09:19:04 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 09:19:04 user nova-compute[75017]:         </nova:port>
Oct 30 09:19:04 user nova-compute[75017]:       </nova:ports>
Oct 30 09:19:04 user nova-compute[75017]:     </nova:instance>
Oct 30 09:19:04 user nova-compute[75017]:   </metadata>
Oct 30 09:19:04 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:19:04 user nova-compute[75017]:     <system>
Oct 30 09:19:04 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:19:04 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:19:04 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:19:04 user nova-compute[75017]:       <entry name="serial">75bb6699-a0c6-4f04-9fca-b0c20b6c0162</entry>
Oct 30 09:19:04 user nova-compute[75017]:       <entry name="uuid">75bb6699-a0c6-4f04-9fca-b0c20b6c0162</entry>
Oct 30 09:19:04 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:19:04 user nova-compute[75017]:     </system>
Oct 30 09:19:04 user nova-compute[75017]:   </sysinfo>
Oct 30 09:19:04 user nova-compute[75017]:   <os>
Oct 30 09:19:04 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:19:04 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:19:04 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:19:04 user nova-compute[75017]:   </os>
Oct 30 09:19:04 user nova-compute[75017]:   <features>
Oct 30 09:19:04 user nova-compute[75017]:     <acpi/>
Oct 30 09:19:04 user nova-compute[75017]:     <apic/>
Oct 30 09:19:04 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:19:04 user nova-compute[75017]:   </features>
Oct 30 09:19:04 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:19:04 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:19:04 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:19:04 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:19:04 user nova-compute[75017]:   </clock>
Oct 30 09:19:04 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:19:04 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:19:04 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:19:04 user nova-compute[75017]:   </cpu>
Oct 30 09:19:04 user nova-compute[75017]:   <devices>
Oct 30 09:19:04 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:19:04 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:19:04 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk"/>
Oct 30 09:19:04 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:19:04 user nova-compute[75017]:     </disk>
Oct 30 09:19:04 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:19:04 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:19:04 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:19:04 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:19:04 user nova-compute[75017]:       <serial>76578c94-dbfd-4ae7-a51e-d1113879fc14</serial>
Oct 30 09:19:04 user nova-compute[75017]:     </disk>
Oct 30 09:19:04 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:19:04 user nova-compute[75017]:       <mac address="fa:16:3e:7d:00:b5"/>
Oct 30 09:19:04 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:19:04 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:19:04 user nova-compute[75017]:       <target dev="tap8c6c6da9-86"/>
Oct 30 09:19:04 user nova-compute[75017]:     </interface>
Oct 30 09:19:04 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:19:04 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/console.log" append="off"/>
Oct 30 09:19:04 user nova-compute[75017]:     </serial>
Oct 30 09:19:04 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:19:04 user nova-compute[75017]:     <video>
Oct 30 09:19:04 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:19:04 user nova-compute[75017]:     </video>
Oct 30 09:19:04 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:19:04 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:19:04 user nova-compute[75017]:     </rng>
Oct 30 09:19:04 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:19:04 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:19:04 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:19:04 user nova-compute[75017]:     </memballoon>
Oct 30 09:19:04 user nova-compute[75017]:   </devices>
Oct 30 09:19:04 user nova-compute[75017]: </domain>
Oct 30 09:19:04 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1576787538',display_name='tempest-ServerActionsTestOtherA-server-562515772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1576787538',id=14,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ0D6pPliPvw56NeAbr78L4cM6urRqlbH/HwVTIC+dhKSceCfYhmC9ZsFcU6onZI0QNuc+Jo53dGW/cYd6EH1dN5NBpAtDlqFj9M8umKfz8L6hmG4gKRGk7vkrHTwKdKg==',key_name='tempest-keypair-717482653',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-39dtqb84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=75bb6699-a0c6-4f04-9fca-b0c20b6c0162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG os_vif [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0397226-bf46-540a-aaec-6a3ff9eec483', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c6c6da9-86, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c6c6da9-86, col_values=(('qos', UUID('938f8739-43b3-4077-8bed-0cb1ce7a5a4c')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c6c6da9-86, col_values=(('external_ids', {'iface-id': '8c6c6da9-86d9-442f-905d-7f96f9dc53cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:00:b5', 'vm-uuid': '75bb6699-a0c6-4f04-9fca-b0c20b6c0162'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:04 user nova-compute[75017]: INFO os_vif [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86')
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] No VIF found with MAC fa:16:3e:7d:00:b5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df215875-673c-4446-afa1-3446ff63edbd {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:04 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Took 1.06 seconds to deallocate network for instance.
Oct 30 09:19:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-0f86c790-c27b-4e33-aa0c-04b257e1f53b req-964849d9-4652-4b26-952a-aff9bafac30a service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received event network-vif-plugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0f86c790-c27b-4e33-aa0c-04b257e1f53b req-964849d9-4652-4b26-952a-aff9bafac30a service nova] Acquiring lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0f86c790-c27b-4e33-aa0c-04b257e1f53b req-964849d9-4652-4b26-952a-aff9bafac30a service nova] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0f86c790-c27b-4e33-aa0c-04b257e1f53b req-964849d9-4652-4b26-952a-aff9bafac30a service nova] Lock "d46e94f6-465d-4112-868e-acf8cea4f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-0f86c790-c27b-4e33-aa0c-04b257e1f53b req-964849d9-4652-4b26-952a-aff9bafac30a service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] No waiting events found dispatching network-vif-plugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:05 user nova-compute[75017]: WARNING nova.compute.manager [req-0f86c790-c27b-4e33-aa0c-04b257e1f53b req-964849d9-4652-4b26-952a-aff9bafac30a service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received unexpected event network-vif-plugged-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 for instance with vm_state deleted and task_state None.
Oct 30 09:19:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-0f86c790-c27b-4e33-aa0c-04b257e1f53b req-964849d9-4652-4b26-952a-aff9bafac30a service nova] [instance: d46e94f6-465d-4112-868e-acf8cea4f402] Received event network-vif-deleted-834b1d2f-e0bb-4ba4-a21d-126b54f6f432 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:05 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Deleted allocations for instance d46e94f6-465d-4112-868e-acf8cea4f402
Oct 30 09:19:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c2352b0f-36b6-4217-8a2c-41bc862efb1b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "d46e94f6-465d-4112-868e-acf8cea4f402" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.751s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-bbad5f47-1d0c-4fad-be87-23ccfdeff837 req-41fe33a5-17e2-4d69-bb77-ff3512888adf service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bbad5f47-1d0c-4fad-be87-23ccfdeff837 req-41fe33a5-17e2-4d69-bb77-ff3512888adf service nova] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bbad5f47-1d0c-4fad-be87-23ccfdeff837 req-41fe33a5-17e2-4d69-bb77-ff3512888adf service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bbad5f47-1d0c-4fad-be87-23ccfdeff837 req-41fe33a5-17e2-4d69-bb77-ff3512888adf service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-bbad5f47-1d0c-4fad-be87-23ccfdeff837 req-41fe33a5-17e2-4d69-bb77-ff3512888adf service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] No waiting events found dispatching network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:06 user nova-compute[75017]: WARNING nova.compute.manager [req-bbad5f47-1d0c-4fad-be87-23ccfdeff837 req-41fe33a5-17e2-4d69-bb77-ff3512888adf service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received unexpected event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf for instance with vm_state active and task_state rebuild_spawning.
Oct 30 09:19:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:19:06 user nova-compute[75017]: INFO nova.compute.claims [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Claim successful on node user
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.network.neutron [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:19:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:19:06 user nova-compute[75017]: DEBUG nova.policy [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a5a90dea2584329b7baf5cb83236091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2479037737af4b3e925a3d8f99c638ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:19:07 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Creating image(s)
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "/opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "/opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.208s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk 1073741824" returned: 0 in 0.072s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG nova.network.neutron [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Successfully created port: 5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Cannot resize image /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Ensure instance console log exists: /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-a643b489-bc83-4b2c-893c-8cd1087ec850 req-33886e10-581e-4f72-9ff0-bc2ceef3d707 service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a643b489-bc83-4b2c-893c-8cd1087ec850 req-33886e10-581e-4f72-9ff0-bc2ceef3d707 service nova] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a643b489-bc83-4b2c-893c-8cd1087ec850 req-33886e10-581e-4f72-9ff0-bc2ceef3d707 service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a643b489-bc83-4b2c-893c-8cd1087ec850 req-33886e10-581e-4f72-9ff0-bc2ceef3d707 service nova] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-a643b489-bc83-4b2c-893c-8cd1087ec850 req-33886e10-581e-4f72-9ff0-bc2ceef3d707 service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] No waiting events found dispatching network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:08 user nova-compute[75017]: WARNING nova.compute.manager [req-a643b489-bc83-4b2c-893c-8cd1087ec850 req-33886e10-581e-4f72-9ff0-bc2ceef3d707 service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received unexpected event network-vif-plugged-8c6c6da9-86d9-442f-905d-7f96f9dc53cf for instance with vm_state active and task_state rebuild_spawning.
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.compute.manager [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:19:08 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Instance spawned successfully.
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.network.neutron [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Successfully updated port: 5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "refresh_cache-5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquired lock "refresh_cache-5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.network.neutron [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.compute.manager [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-443e65f0-1e53-4b97-98a2-60788ba31f7a req-8d12501d-c279-4645-8ab1-c08eb449617f service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received event network-changed-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-443e65f0-1e53-4b97-98a2-60788ba31f7a req-8d12501d-c279-4645-8ab1-c08eb449617f service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Refreshing instance network info cache due to event network-changed-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-443e65f0-1e53-4b97-98a2-60788ba31f7a req-8d12501d-c279-4645-8ab1-c08eb449617f service nova] Acquiring lock "refresh_cache-5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.network.neutron [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG nova.objects.instance [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75017) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Oct 30 09:19:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0484faef-eed6-4046-9b10-f1e12f7c22f0 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.106s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.network.neutron [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Updating instance_info_cache with network_info: [{"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Releasing lock "refresh_cache-5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Instance network_info: |[{"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-443e65f0-1e53-4b97-98a2-60788ba31f7a req-8d12501d-c279-4645-8ab1-c08eb449617f service nova] Acquired lock "refresh_cache-5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.network.neutron [req-443e65f0-1e53-4b97-98a2-60788ba31f7a req-8d12501d-c279-4645-8ab1-c08eb449617f service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Refreshing network info cache for port 5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Start _get_guest_xml network_info=[{"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:09 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:19:09 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2003748459',display_name='tempest-VolumesSnapshotTestJSON-instance-2003748459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2003748459',id=20,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUW1t4+rLM2/ftuVG7Q4geqanKuoSfGKJKhL0xoNkAkbWXZHzuJxFkIy8RDrafQ4o5SODs3PqY1Q7seEiQWa2TGGq+3eVqXlLkVmTtnZ0Twk6XcgrlDXch5fzzOyxbeqw==',key_name='tempest-keypair-710799537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2479037737af4b3e925a3d8f99c638ff',ramdisk_id='',reservation_id='r-1bk73cwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-681659515',owner_user_name='tempest-VolumesSnapshotTestJSON-681659515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5a90dea2584329b7baf5cb83236091',uuid=5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converting VIF {"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:07:d6,bridge_name='br-int',has_traffic_filtering=True,id=5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5da3deb4-c4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.objects.instance [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:19:09 user nova-compute[75017]:   <uuid>5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa</uuid>
Oct 30 09:19:09 user nova-compute[75017]:   <name>instance-00000014</name>
Oct 30 09:19:09 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:19:09 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:19:09 user nova-compute[75017]:   <metadata>
Oct 30 09:19:09 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:19:09 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:19:09 user nova-compute[75017]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2003748459</nova:name>
Oct 30 09:19:09 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:19:09</nova:creationTime>
Oct 30 09:19:09 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:19:09 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:19:09 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:19:09 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:19:09 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:19:09 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:19:09 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:19:09 user nova-compute[75017]:       <nova:owner>
Oct 30 09:19:09 user nova-compute[75017]:         <nova:user uuid="3a5a90dea2584329b7baf5cb83236091">tempest-VolumesSnapshotTestJSON-681659515-project-member</nova:user>
Oct 30 09:19:09 user nova-compute[75017]:         <nova:project uuid="2479037737af4b3e925a3d8f99c638ff">tempest-VolumesSnapshotTestJSON-681659515</nova:project>
Oct 30 09:19:09 user nova-compute[75017]:       </nova:owner>
Oct 30 09:19:09 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:19:09 user nova-compute[75017]:       <nova:ports>
Oct 30 09:19:09 user nova-compute[75017]:         <nova:port uuid="5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd">
Oct 30 09:19:09 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 09:19:09 user nova-compute[75017]:         </nova:port>
Oct 30 09:19:09 user nova-compute[75017]:       </nova:ports>
Oct 30 09:19:09 user nova-compute[75017]:     </nova:instance>
Oct 30 09:19:09 user nova-compute[75017]:   </metadata>
Oct 30 09:19:09 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:19:09 user nova-compute[75017]:     <system>
Oct 30 09:19:09 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:19:09 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:19:09 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:19:09 user nova-compute[75017]:       <entry name="serial">5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa</entry>
Oct 30 09:19:09 user nova-compute[75017]:       <entry name="uuid">5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa</entry>
Oct 30 09:19:09 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:19:09 user nova-compute[75017]:     </system>
Oct 30 09:19:09 user nova-compute[75017]:   </sysinfo>
Oct 30 09:19:09 user nova-compute[75017]:   <os>
Oct 30 09:19:09 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:19:09 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:19:09 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:19:09 user nova-compute[75017]:   </os>
Oct 30 09:19:09 user nova-compute[75017]:   <features>
Oct 30 09:19:09 user nova-compute[75017]:     <acpi/>
Oct 30 09:19:09 user nova-compute[75017]:     <apic/>
Oct 30 09:19:09 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:19:09 user nova-compute[75017]:   </features>
Oct 30 09:19:09 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:19:09 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:19:09 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:19:09 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:19:09 user nova-compute[75017]:   </clock>
Oct 30 09:19:09 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:19:09 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:19:09 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:19:09 user nova-compute[75017]:   </cpu>
Oct 30 09:19:09 user nova-compute[75017]:   <devices>
Oct 30 09:19:09 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:19:09 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:19:09 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk"/>
Oct 30 09:19:09 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:19:09 user nova-compute[75017]:     </disk>
Oct 30 09:19:09 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:19:09 user nova-compute[75017]:       <mac address="fa:16:3e:4d:07:d6"/>
Oct 30 09:19:09 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:19:09 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:19:09 user nova-compute[75017]:       <target dev="tap5da3deb4-c4"/>
Oct 30 09:19:09 user nova-compute[75017]:     </interface>
Oct 30 09:19:09 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:19:09 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/console.log" append="off"/>
Oct 30 09:19:09 user nova-compute[75017]:     </serial>
Oct 30 09:19:09 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:19:09 user nova-compute[75017]:     <video>
Oct 30 09:19:09 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:19:09 user nova-compute[75017]:     </video>
Oct 30 09:19:09 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:19:09 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:19:09 user nova-compute[75017]:     </rng>
Oct 30 09:19:09 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:19:09 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:19:09 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:19:09 user nova-compute[75017]:     </memballoon>
Oct 30 09:19:09 user nova-compute[75017]:   </devices>
Oct 30 09:19:09 user nova-compute[75017]: </domain>
Oct 30 09:19:09 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2003748459',display_name='tempest-VolumesSnapshotTestJSON-instance-2003748459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2003748459',id=20,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUW1t4+rLM2/ftuVG7Q4geqanKuoSfGKJKhL0xoNkAkbWXZHzuJxFkIy8RDrafQ4o5SODs3PqY1Q7seEiQWa2TGGq+3eVqXlLkVmTtnZ0Twk6XcgrlDXch5fzzOyxbeqw==',key_name='tempest-keypair-710799537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2479037737af4b3e925a3d8f99c638ff',ramdisk_id='',reservation_id='r-1bk73cwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-681659515',owner_user_name='tempest-VolumesSnapshotTestJSON-681659515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5a90dea2584329b7baf5cb83236091',uuid=5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converting VIF {"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:07:d6,bridge_name='br-int',has_traffic_filtering=True,id=5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5da3deb4-c4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG os_vif [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:07:d6,bridge_name='br-int',has_traffic_filtering=True,id=5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5da3deb4-c4') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd325619e-e7e8-5b58-a518-ce61b623cd39', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5da3deb4-c4, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5da3deb4-c4, col_values=(('qos', UUID('277b6ebc-7e04-4a52-a8b5-d718df620383')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5da3deb4-c4, col_values=(('external_ids', {'iface-id': '5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:07:d6', 'vm-uuid': '5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:09 user nova-compute[75017]: INFO os_vif [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:07:d6,bridge_name='br-int',has_traffic_filtering=True,id=5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5da3deb4-c4')
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No VIF found with MAC fa:16:3e:4d:07:d6, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.network.neutron [req-443e65f0-1e53-4b97-98a2-60788ba31f7a req-8d12501d-c279-4645-8ab1-c08eb449617f service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Updated VIF entry in instance network info cache for port 5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG nova.network.neutron [req-443e65f0-1e53-4b97-98a2-60788ba31f7a req-8d12501d-c279-4645-8ab1-c08eb449617f service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Updating instance_info_cache with network_info: [{"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-443e65f0-1e53-4b97-98a2-60788ba31f7a req-8d12501d-c279-4645-8ab1-c08eb449617f service nova] Releasing lock "refresh_cache-5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:19:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:10 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:19:10 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:19:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:11 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:19:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-9adf8f64-2311-4476-bc24-a191868816b4 req-864fa571-0b33-4e61-8538-77a1c043a96b service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received event network-vif-plugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9adf8f64-2311-4476-bc24-a191868816b4 req-864fa571-0b33-4e61-8538-77a1c043a96b service nova] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9adf8f64-2311-4476-bc24-a191868816b4 req-864fa571-0b33-4e61-8538-77a1c043a96b service nova] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9adf8f64-2311-4476-bc24-a191868816b4 req-864fa571-0b33-4e61-8538-77a1c043a96b service nova] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-9adf8f64-2311-4476-bc24-a191868816b4 req-864fa571-0b33-4e61-8538-77a1c043a96b service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] No waiting events found dispatching network-vif-plugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:11 user nova-compute[75017]: WARNING nova.compute.manager [req-9adf8f64-2311-4476-bc24-a191868816b4 req-864fa571-0b33-4e61-8538-77a1c043a96b service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received unexpected event network-vif-plugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd for instance with vm_state building and task_state spawning.
Oct 30 09:19:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:12 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:19:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:19:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.compute.manager [req-396b5b26-b765-4f7f-8d9f-67d74d7b3ea6 req-db4f924b-e35f-48fa-b402-cd6b60c58876 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received event network-vif-plugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-396b5b26-b765-4f7f-8d9f-67d74d7b3ea6 req-db4f924b-e35f-48fa-b402-cd6b60c58876 service nova] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-396b5b26-b765-4f7f-8d9f-67d74d7b3ea6 req-db4f924b-e35f-48fa-b402-cd6b60c58876 service nova] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-396b5b26-b765-4f7f-8d9f-67d74d7b3ea6 req-db4f924b-e35f-48fa-b402-cd6b60c58876 service nova] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.compute.manager [req-396b5b26-b765-4f7f-8d9f-67d74d7b3ea6 req-db4f924b-e35f-48fa-b402-cd6b60c58876 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] No waiting events found dispatching network-vif-plugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:13 user nova-compute[75017]: WARNING nova.compute.manager [req-396b5b26-b765-4f7f-8d9f-67d74d7b3ea6 req-db4f924b-e35f-48fa-b402-cd6b60c58876 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received unexpected event network-vif-plugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd for instance with vm_state building and task_state spawning.
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:19:13 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Instance spawned successfully.
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:13 user nova-compute[75017]: INFO nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Took 6.91 seconds to spawn the instance on the hypervisor.
Oct 30 09:19:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:14 user nova-compute[75017]: INFO nova.compute.manager [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Took 7.85 seconds to build instance.
Oct 30 09:19:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-85101d8c-a7e1-432c-a5ea-f87ebda4a0f5 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.978s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:19:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:18 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:19:18 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7430MB free_disk=25.44504165649414GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance df215875-673c-4446-afa1-3446ff63edbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 3833002b-0acf-4093-8f10-097760487c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d70af571-8573-4ef5-82e8-9b30084616df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:19:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.599s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:19:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:19:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:19:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:19:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:19:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:19:20 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:19:20 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid 35e56f63-7e8b-4324-b16c-b4fac5bb0087 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:19:21 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updating instance_info_cache with network_info: [{"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:19:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:19:21 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:19:21 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:19:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:19:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-ef8588d6-6d77-4cb1-9e08-8915b7e14b82 req-fee2cdac-8e6d-4461-b400-88faf2572bda service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-changed-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-ef8588d6-6d77-4cb1-9e08-8915b7e14b82 req-fee2cdac-8e6d-4461-b400-88faf2572bda service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Refreshing instance network info cache due to event network-changed-8a2b14a4-3ecb-4c54-ac67-7917a612e660. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:19:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ef8588d6-6d77-4cb1-9e08-8915b7e14b82 req-fee2cdac-8e6d-4461-b400-88faf2572bda service nova] Acquiring lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:19:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ef8588d6-6d77-4cb1-9e08-8915b7e14b82 req-fee2cdac-8e6d-4461-b400-88faf2572bda service nova] Acquired lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:19:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-ef8588d6-6d77-4cb1-9e08-8915b7e14b82 req-fee2cdac-8e6d-4461-b400-88faf2572bda service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Refreshing network info cache for port 8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG nova.network.neutron [req-ef8588d6-6d77-4cb1-9e08-8915b7e14b82 req-fee2cdac-8e6d-4461-b400-88faf2572bda service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updated VIF entry in instance network info cache for port 8a2b14a4-3ecb-4c54-ac67-7917a612e660. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG nova.network.neutron [req-ef8588d6-6d77-4cb1-9e08-8915b7e14b82 req-fee2cdac-8e6d-4461-b400-88faf2572bda service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ef8588d6-6d77-4cb1-9e08-8915b7e14b82 req-fee2cdac-8e6d-4461-b400-88faf2572bda service nova] Releasing lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:24 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance df215875-673c-4446-afa1-3446ff63edbd is timed out.
Oct 30 09:19:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Successfully detached device vdb from instance df215875-673c-4446-afa1-3446ff63edbd from the live domain config.
Oct 30 09:19:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ugEbaUGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:19:24 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9972fda9-9ceb-4f83-b6b7-da0b1d3f77a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:19:24 user nova-compute[75017]: No targets found.
Oct 30 09:19:24 user nova-compute[75017]: iSNS:
Oct 30 09:19:24 user nova-compute[75017]: No targets found.
Oct 30 09:19:24 user nova-compute[75017]: STATIC:
Oct 30 09:19:24 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14
Oct 30 09:19:24 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:19:24 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:19:24 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d
Oct 30 09:19:24 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:19:24 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:19:24 user nova-compute[75017]: FIRMWARE:
Oct 30 09:19:24 user nova-compute[75017]: No targets found.
Oct 30 09:19:24 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:19:24 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:19:24 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bcc266-7dd6-4629-b01d-6429916b9003]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e903f801-bc96-41e5-8d73-3453d7d71827]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:19:24 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:19:24 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:19:24 user nova-compute[75017]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d (non-flash)
Oct 30 09:19:24 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccdcce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d'): ({'sdf'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Removing single pathed devices sdf {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[555eb140-f002-431b-bd81-27c3a5a2a077]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[344d84cf-594b-4bd9-9a15-2399e30b38aa]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Flushing IO for device /dev/sdf {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab55681-7267-4558-8173-d38913665777]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d34ba52-e636-43a4-8b44-3851e79e8fa7]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] SCSI volumes sdf have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd07df29-e28f-4ff0-83d9-f8b37927ee94]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f23a7f8-964d-4fba-bf5e-39019af33828]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d, portal: 172.16.0.220,3260]
Oct 30 09:19:24 user nova-compute[75017]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d, portal: 172.16.0.220,3260] successful.
Oct 30 09:19:24 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f7087a-5183-4876-8f2b-e1f87b452c3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e817018-c7ab-4bb3-9d27-10e629d014a3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] <== disconnect_volume: return (359ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:19:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:19:25 user nova-compute[75017]: INFO nova.compute.manager [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] instance snapshotting
Oct 30 09:19:25 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Beginning live snapshot process
Oct 30 09:19:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json -f qcow2 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json -f qcow2 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json -f qcow2" returned: 0 in 0.224s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lazy-loading 'flavor' on Instance uuid df215875-673c-4446-afa1-3446ff63edbd {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d7c680db-8c6b-49d2-9af2-1b709d934275 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.133s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2gzzymjd/417b36759f6e44ac8d6b263a1e5d8249.delta 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2gzzymjd/417b36759f6e44ac8d6b263a1e5d8249.delta 1073741824" returned: 0 in 0.058s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:25 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 09:19:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75017) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 09:19:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75017) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 09:19:27 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 09:19:27 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:19:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2gzzymjd/417b36759f6e44ac8d6b263a1e5d8249.delta /opt/stack/data/nova/instances/snapshots/tmp2gzzymjd/417b36759f6e44ac8d6b263a1e5d8249 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2gzzymjd/417b36759f6e44ac8d6b263a1e5d8249.delta /opt/stack/data/nova/instances/snapshots/tmp2gzzymjd/417b36759f6e44ac8d6b263a1e5d8249" returned: 0 in 0.833s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Snapshot extracted, beginning image upload
Oct 30 09:19:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Snapshot image upload complete
Oct 30 09:19:31 user nova-compute[75017]: INFO nova.compute.manager [None req-226cec84-bfbe-4690-9e9d-e2583ae61e68 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Took 6.14 seconds to snapshot the instance on the hypervisor.
Oct 30 09:19:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "e44fccb6-efe6-461a-91d0-bf1628183258" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "e44fccb6-efe6-461a-91d0-bf1628183258" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:19:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:19:33 user nova-compute[75017]: INFO nova.compute.claims [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Claim successful on node user
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:19:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.policy [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35a9a593584b4225af22375653d9c33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98308afa3b794383aca709bceceae3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:19:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Creating image(s)
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "/opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "/opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "/opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk 1073741824" returned: 0 in 0.060s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Successfully created port: db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Cannot resize image /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Ensure instance console log exists: /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG nova.network.neutron [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Successfully updated port: db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "refresh_cache-e44fccb6-efe6-461a-91d0-bf1628183258" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquired lock "refresh_cache-e44fccb6-efe6-461a-91d0-bf1628183258" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG nova.network.neutron [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-971b7412-d4ac-41aa-9d35-56a0ccff1576 req-5d2e90a4-c473-4744-8939-fa11abae146d service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received event network-changed-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-971b7412-d4ac-41aa-9d35-56a0ccff1576 req-5d2e90a4-c473-4744-8939-fa11abae146d service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Refreshing instance network info cache due to event network-changed-db61c098-ec9c-4f0c-9673-192f7b917040. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-971b7412-d4ac-41aa-9d35-56a0ccff1576 req-5d2e90a4-c473-4744-8939-fa11abae146d service nova] Acquiring lock "refresh_cache-e44fccb6-efe6-461a-91d0-bf1628183258" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:19:35 user nova-compute[75017]: DEBUG nova.network.neutron [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Updating instance_info_cache with network_info: [{"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Releasing lock "refresh_cache-e44fccb6-efe6-461a-91d0-bf1628183258" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Instance network_info: |[{"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-971b7412-d4ac-41aa-9d35-56a0ccff1576 req-5d2e90a4-c473-4744-8939-fa11abae146d service nova] Acquired lock "refresh_cache-e44fccb6-efe6-461a-91d0-bf1628183258" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-971b7412-d4ac-41aa-9d35-56a0ccff1576 req-5d2e90a4-c473-4744-8939-fa11abae146d service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Refreshing network info cache for port db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Start _get_guest_xml network_info=[{"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:19:36 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:19:36 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1635746805',display_name='tempest-ServersNegativeTestJSON-server-1635746805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1635746805',id=21,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98308afa3b794383aca709bceceae3a5',ramdisk_id='',reservation_id='r-bouhyfcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1551770249',owner_user_name='tempest-ServersNegativeTestJSON-1551770249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:19:34Z,user_data=None,user_id='35a9a593584b4225af22375653d9c33a',uuid=e44fccb6-efe6-461a-91d0-bf1628183258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converting VIF {"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:14:65,bridge_name='br-int',has_traffic_filtering=True,id=db61c098-ec9c-4f0c-9673-192f7b917040,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb61c098-ec') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.objects.instance [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lazy-loading 'pci_devices' on Instance uuid e44fccb6-efe6-461a-91d0-bf1628183258 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:19:36 user nova-compute[75017]:   <uuid>e44fccb6-efe6-461a-91d0-bf1628183258</uuid>
Oct 30 09:19:36 user nova-compute[75017]:   <name>instance-00000015</name>
Oct 30 09:19:36 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:19:36 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:19:36 user nova-compute[75017]:   <metadata>
Oct 30 09:19:36 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:19:36 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:19:36 user nova-compute[75017]:       <nova:name>tempest-ServersNegativeTestJSON-server-1635746805</nova:name>
Oct 30 09:19:36 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:19:36</nova:creationTime>
Oct 30 09:19:36 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:19:36 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:19:36 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:19:36 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:19:36 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:19:36 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:19:36 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:19:36 user nova-compute[75017]:       <nova:owner>
Oct 30 09:19:36 user nova-compute[75017]:         <nova:user uuid="35a9a593584b4225af22375653d9c33a">tempest-ServersNegativeTestJSON-1551770249-project-member</nova:user>
Oct 30 09:19:36 user nova-compute[75017]:         <nova:project uuid="98308afa3b794383aca709bceceae3a5">tempest-ServersNegativeTestJSON-1551770249</nova:project>
Oct 30 09:19:36 user nova-compute[75017]:       </nova:owner>
Oct 30 09:19:36 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:19:36 user nova-compute[75017]:       <nova:ports>
Oct 30 09:19:36 user nova-compute[75017]:         <nova:port uuid="db61c098-ec9c-4f0c-9673-192f7b917040">
Oct 30 09:19:36 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:19:36 user nova-compute[75017]:         </nova:port>
Oct 30 09:19:36 user nova-compute[75017]:       </nova:ports>
Oct 30 09:19:36 user nova-compute[75017]:     </nova:instance>
Oct 30 09:19:36 user nova-compute[75017]:   </metadata>
Oct 30 09:19:36 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:19:36 user nova-compute[75017]:     <system>
Oct 30 09:19:36 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:19:36 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:19:36 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:19:36 user nova-compute[75017]:       <entry name="serial">e44fccb6-efe6-461a-91d0-bf1628183258</entry>
Oct 30 09:19:36 user nova-compute[75017]:       <entry name="uuid">e44fccb6-efe6-461a-91d0-bf1628183258</entry>
Oct 30 09:19:36 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:19:36 user nova-compute[75017]:     </system>
Oct 30 09:19:36 user nova-compute[75017]:   </sysinfo>
Oct 30 09:19:36 user nova-compute[75017]:   <os>
Oct 30 09:19:36 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:19:36 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:19:36 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:19:36 user nova-compute[75017]:   </os>
Oct 30 09:19:36 user nova-compute[75017]:   <features>
Oct 30 09:19:36 user nova-compute[75017]:     <acpi/>
Oct 30 09:19:36 user nova-compute[75017]:     <apic/>
Oct 30 09:19:36 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:19:36 user nova-compute[75017]:   </features>
Oct 30 09:19:36 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:19:36 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:19:36 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:19:36 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:19:36 user nova-compute[75017]:   </clock>
Oct 30 09:19:36 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:19:36 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:19:36 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:19:36 user nova-compute[75017]:   </cpu>
Oct 30 09:19:36 user nova-compute[75017]:   <devices>
Oct 30 09:19:36 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:19:36 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:19:36 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk"/>
Oct 30 09:19:36 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:19:36 user nova-compute[75017]:     </disk>
Oct 30 09:19:36 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:19:36 user nova-compute[75017]:       <mac address="fa:16:3e:90:14:65"/>
Oct 30 09:19:36 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:19:36 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:19:36 user nova-compute[75017]:       <target dev="tapdb61c098-ec"/>
Oct 30 09:19:36 user nova-compute[75017]:     </interface>
Oct 30 09:19:36 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:19:36 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/console.log" append="off"/>
Oct 30 09:19:36 user nova-compute[75017]:     </serial>
Oct 30 09:19:36 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:19:36 user nova-compute[75017]:     <video>
Oct 30 09:19:36 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:19:36 user nova-compute[75017]:     </video>
Oct 30 09:19:36 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:19:36 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:19:36 user nova-compute[75017]:     </rng>
Oct 30 09:19:36 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:19:36 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:19:36 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:19:36 user nova-compute[75017]:     </memballoon>
Oct 30 09:19:36 user nova-compute[75017]:   </devices>
Oct 30 09:19:36 user nova-compute[75017]: </domain>
Oct 30 09:19:36 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1635746805',display_name='tempest-ServersNegativeTestJSON-server-1635746805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1635746805',id=21,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98308afa3b794383aca709bceceae3a5',ramdisk_id='',reservation_id='r-bouhyfcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1551770249',owner_user_name='tempest-ServersNegativeTestJSON-1551770249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:19:34Z,user_data=None,user_id='35a9a593584b4225af22375653d9c33a',uuid=e44fccb6-efe6-461a-91d0-bf1628183258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converting VIF {"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:14:65,bridge_name='br-int',has_traffic_filtering=True,id=db61c098-ec9c-4f0c-9673-192f7b917040,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb61c098-ec') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG os_vif [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:14:65,bridge_name='br-int',has_traffic_filtering=True,id=db61c098-ec9c-4f0c-9673-192f7b917040,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb61c098-ec') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9764bba8-113c-55f6-80b1-51f821c1d230', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb61c098-ec, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb61c098-ec, col_values=(('qos', UUID('6331e0d1-da28-410d-ad3e-69c0c1612537')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb61c098-ec, col_values=(('external_ids', {'iface-id': 'db61c098-ec9c-4f0c-9673-192f7b917040', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:14:65', 'vm-uuid': 'e44fccb6-efe6-461a-91d0-bf1628183258'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:36 user nova-compute[75017]: INFO os_vif [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:14:65,bridge_name='br-int',has_traffic_filtering=True,id=db61c098-ec9c-4f0c-9673-192f7b917040,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb61c098-ec')
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] No VIF found with MAC fa:16:3e:90:14:65, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-971b7412-d4ac-41aa-9d35-56a0ccff1576 req-5d2e90a4-c473-4744-8939-fa11abae146d service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Updated VIF entry in instance network info cache for port db61c098-ec9c-4f0c-9673-192f7b917040. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-971b7412-d4ac-41aa-9d35-56a0ccff1576 req-5d2e90a4-c473-4744-8939-fa11abae146d service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Updating instance_info_cache with network_info: [{"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-971b7412-d4ac-41aa-9d35-56a0ccff1576 req-5d2e90a4-c473-4744-8939-fa11abae146d service nova] Releasing lock "refresh_cache-e44fccb6-efe6-461a-91d0-bf1628183258" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:19:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-18b94392-1ab5-43b2-b8af-93e06ff2fa0d req-fd22ebaa-6d3c-4883-8694-337ff55f908b service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received event network-vif-plugged-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-18b94392-1ab5-43b2-b8af-93e06ff2fa0d req-fd22ebaa-6d3c-4883-8694-337ff55f908b service nova] Acquiring lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-18b94392-1ab5-43b2-b8af-93e06ff2fa0d req-fd22ebaa-6d3c-4883-8694-337ff55f908b service nova] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-18b94392-1ab5-43b2-b8af-93e06ff2fa0d req-fd22ebaa-6d3c-4883-8694-337ff55f908b service nova] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-18b94392-1ab5-43b2-b8af-93e06ff2fa0d req-fd22ebaa-6d3c-4883-8694-337ff55f908b service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] No waiting events found dispatching network-vif-plugged-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:38 user nova-compute[75017]: WARNING nova.compute.manager [req-18b94392-1ab5-43b2-b8af-93e06ff2fa0d req-fd22ebaa-6d3c-4883-8694-337ff55f908b service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received unexpected event network-vif-plugged-db61c098-ec9c-4f0c-9673-192f7b917040 for instance with vm_state building and task_state spawning.
Oct 30 09:19:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:19:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Instance spawned successfully.
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-49e5a16d-9914-45c0-9052-c642b39f9722 req-995c41c3-2598-4ec0-81f7-acda5506fa20 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received event network-vif-plugged-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-49e5a16d-9914-45c0-9052-c642b39f9722 req-995c41c3-2598-4ec0-81f7-acda5506fa20 service nova] Acquiring lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-49e5a16d-9914-45c0-9052-c642b39f9722 req-995c41c3-2598-4ec0-81f7-acda5506fa20 service nova] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-49e5a16d-9914-45c0-9052-c642b39f9722 req-995c41c3-2598-4ec0-81f7-acda5506fa20 service nova] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-49e5a16d-9914-45c0-9052-c642b39f9722 req-995c41c3-2598-4ec0-81f7-acda5506fa20 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] No waiting events found dispatching network-vif-plugged-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:40 user nova-compute[75017]: WARNING nova.compute.manager [req-49e5a16d-9914-45c0-9052-c642b39f9722 req-995c41c3-2598-4ec0-81f7-acda5506fa20 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received unexpected event network-vif-plugged-db61c098-ec9c-4f0c-9673-192f7b917040 for instance with vm_state building and task_state spawning.
Oct 30 09:19:40 user nova-compute[75017]: INFO nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Took 5.96 seconds to spawn the instance on the hypervisor.
Oct 30 09:19:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:19:40 user nova-compute[75017]: INFO nova.compute.manager [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Took 6.75 seconds to build instance.
Oct 30 09:19:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3fff33fc-265e-4daf-886b-1c1d54456a3c tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "e44fccb6-efe6-461a-91d0-bf1628183258" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.870s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:48 user nova-compute[75017]: INFO nova.compute.manager [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Terminating instance
Oct 30 09:19:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-8b015cf9-291c-47e7-85c8-9b6f19f848e0 req-30ddd034-f30b-47fc-9dc1-16c52077b3fc service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received event network-vif-unplugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8b015cf9-291c-47e7-85c8-9b6f19f848e0 req-30ddd034-f30b-47fc-9dc1-16c52077b3fc service nova] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8b015cf9-291c-47e7-85c8-9b6f19f848e0 req-30ddd034-f30b-47fc-9dc1-16c52077b3fc service nova] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8b015cf9-291c-47e7-85c8-9b6f19f848e0 req-30ddd034-f30b-47fc-9dc1-16c52077b3fc service nova] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-8b015cf9-291c-47e7-85c8-9b6f19f848e0 req-30ddd034-f30b-47fc-9dc1-16c52077b3fc service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] No waiting events found dispatching network-vif-unplugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-8b015cf9-291c-47e7-85c8-9b6f19f848e0 req-30ddd034-f30b-47fc-9dc1-16c52077b3fc service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received event network-vif-unplugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:19:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Instance destroyed successfully.
Oct 30 09:19:49 user nova-compute[75017]: DEBUG nova.objects.instance [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lazy-loading 'resources' on Instance uuid 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-270939356',display_name='tempest-VolumesAdminNegativeTest-server-270939356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-270939356',id=5,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHNc8rrpNEYL8lRHeX6hYYw6LKv/Zomz4CcXcw1qIO26QgHSS2jQsg+07/z7J61cxiN92ghZHYHKw03chZZKBSHxp5JF/AJw1+/seyLdui49R5J6Z5fuYjYzT7GPGawTg==',key_name='tempest-keypair-1675065355',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70c6be03e11b42249f25e6a80223f16f',ramdisk_id='',reservation_id='r-jhrrql7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-790420406',owner_user_name='tempest-VolumesAdminNegativeTest-790420406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70705b579acb43ef8420b6fa57c64e12',uuid=1ce8eb40-b1ce-4b89-b19e-5d45be9687f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converting VIF {"id": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "address": "fa:16:3e:00:96:2d", "network": {"id": "dd428490-0706-43ce-8706-8f3c92be6f76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1445159151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c6be03e11b42249f25e6a80223f16f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf159fe03-fe", "ovs_interfaceid": "f159fe03-fe4c-4373-9e01-c65efbcf5c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=f159fe03-fe4c-4373-9e01-c65efbcf5c6b,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf159fe03-fe') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG os_vif [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=f159fe03-fe4c-4373-9e01-c65efbcf5c6b,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf159fe03-fe') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf159fe03-fe, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82ddafa9-2499-42c0-bb25-cc8ca21c60a4) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:49 user nova-compute[75017]: INFO os_vif [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=f159fe03-fe4c-4373-9e01-c65efbcf5c6b,network=Network(dd428490-0706-43ce-8706-8f3c92be6f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf159fe03-fe')
Oct 30 09:19:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Deleting instance files /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6_del
Oct 30 09:19:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Deletion of /opt/stack/data/nova/instances/1ce8eb40-b1ce-4b89-b19e-5d45be9687f6_del complete
Oct 30 09:19:49 user nova-compute[75017]: INFO nova.compute.manager [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 30 09:19:49 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:19:49 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:50 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Took 0.75 seconds to deallocate network for instance.
Oct 30 09:19:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-9a54d940-9a6d-42f2-b390-a9348e55f840 req-a6638600-0136-422d-9335-50ea568df505 service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received event network-vif-deleted-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:50 user nova-compute[75017]: INFO nova.compute.manager [req-9a54d940-9a6d-42f2-b390-a9348e55f840 req-a6638600-0136-422d-9335-50ea568df505 service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Neutron deleted interface f159fe03-fe4c-4373-9e01-c65efbcf5c6b; detaching it from the instance and deleting it from the info cache
Oct 30 09:19:50 user nova-compute[75017]: DEBUG nova.network.neutron [req-9a54d940-9a6d-42f2-b390-a9348e55f840 req-a6638600-0136-422d-9335-50ea568df505 service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-9a54d940-9a6d-42f2-b390-a9348e55f840 req-a6638600-0136-422d-9335-50ea568df505 service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Detach interface failed, port_id=f159fe03-fe4c-4373-9e01-c65efbcf5c6b, reason: Instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.007s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:50 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Deleted allocations for instance 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6
Oct 30 09:19:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2e2edfeb-a743-4c91-ab60-dad9aa3cb5a5 tempest-VolumesAdminNegativeTest-790420406 tempest-VolumesAdminNegativeTest-790420406-project-member] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.362s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-460c57d1-fa09-4fed-a9c0-1e82c90c4f35 req-007f5542-4aa6-4a7e-b3e3-d8f611190d55 service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received event network-vif-plugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-460c57d1-fa09-4fed-a9c0-1e82c90c4f35 req-007f5542-4aa6-4a7e-b3e3-d8f611190d55 service nova] Acquiring lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-460c57d1-fa09-4fed-a9c0-1e82c90c4f35 req-007f5542-4aa6-4a7e-b3e3-d8f611190d55 service nova] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-460c57d1-fa09-4fed-a9c0-1e82c90c4f35 req-007f5542-4aa6-4a7e-b3e3-d8f611190d55 service nova] Lock "1ce8eb40-b1ce-4b89-b19e-5d45be9687f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-460c57d1-fa09-4fed-a9c0-1e82c90c4f35 req-007f5542-4aa6-4a7e-b3e3-d8f611190d55 service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] No waiting events found dispatching network-vif-plugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:50 user nova-compute[75017]: WARNING nova.compute.manager [req-460c57d1-fa09-4fed-a9c0-1e82c90c4f35 req-007f5542-4aa6-4a7e-b3e3-d8f611190d55 service nova] [instance: 1ce8eb40-b1ce-4b89-b19e-5d45be9687f6] Received unexpected event network-vif-plugged-f159fe03-fe4c-4373-9e01-c65efbcf5c6b for instance with vm_state deleted and task_state None.
Oct 30 09:19:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:54 user nova-compute[75017]: INFO nova.compute.manager [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Terminating instance
Oct 30 09:19:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-af1ace4b-c61f-4f52-8eab-0335cf38a2a6 req-96812ab7-476b-4842-a9a7-1e1f907fe19a service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received event network-vif-unplugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-af1ace4b-c61f-4f52-8eab-0335cf38a2a6 req-96812ab7-476b-4842-a9a7-1e1f907fe19a service nova] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-af1ace4b-c61f-4f52-8eab-0335cf38a2a6 req-96812ab7-476b-4842-a9a7-1e1f907fe19a service nova] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-af1ace4b-c61f-4f52-8eab-0335cf38a2a6 req-96812ab7-476b-4842-a9a7-1e1f907fe19a service nova] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-af1ace4b-c61f-4f52-8eab-0335cf38a2a6 req-96812ab7-476b-4842-a9a7-1e1f907fe19a service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] No waiting events found dispatching network-vif-unplugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-af1ace4b-c61f-4f52-8eab-0335cf38a2a6 req-96812ab7-476b-4842-a9a7-1e1f907fe19a service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received event network-vif-unplugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:19:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: df215875-673c-4446-afa1-3446ff63edbd] Instance destroyed successfully.
Oct 30 09:19:55 user nova-compute[75017]: DEBUG nova.objects.instance [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lazy-loading 'resources' on Instance uuid df215875-673c-4446-afa1-3446ff63edbd {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1111762858',display_name='tempest-TestVolumeSwap-server-1111762858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1111762858',id=6,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7NI+kWi01jDLCAbpwU0SRvzJP853am//78+XkNM/J9TPaDGVIZwtvIWEFjaiEwNOt9JCyjzz1iNk/D814nevjlSi8YTmA5KlL/OpWu30jGjzLEtwQEp3LKrdu0xctoYA==',key_name='tempest-keypair-90741168',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1013afec1974848b3a4c434e78cc849',ramdisk_id='',reservation_id='r-rq0de9jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-144653908',owner_user_name='tempest-TestVolumeSwap-144653908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd07d295a1ae406eb356f64c61bcfff2',uuid=df215875-673c-4446-afa1-3446ff63edbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Converting VIF {"id": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "address": "fa:16:3e:e7:80:5f", "network": {"id": "61f27ddb-61b1-4856-ac74-4bfecf906272", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1342600717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1013afec1974848b3a4c434e78cc849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf928f8ba-85", "ovs_interfaceid": "f928f8ba-850a-4a21-8553-ab2c3860c8a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:80:5f,bridge_name='br-int',has_traffic_filtering=True,id=f928f8ba-850a-4a21-8553-ab2c3860c8a7,network=Network(61f27ddb-61b1-4856-ac74-4bfecf906272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf928f8ba-85') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG os_vif [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:80:5f,bridge_name='br-int',has_traffic_filtering=True,id=f928f8ba-850a-4a21-8553-ab2c3860c8a7,network=Network(61f27ddb-61b1-4856-ac74-4bfecf906272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf928f8ba-85') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf928f8ba-85, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1572f167-1f55-4d5f-882f-edf951d03e35) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:55 user nova-compute[75017]: INFO os_vif [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:80:5f,bridge_name='br-int',has_traffic_filtering=True,id=f928f8ba-850a-4a21-8553-ab2c3860c8a7,network=Network(61f27ddb-61b1-4856-ac74-4bfecf906272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf928f8ba-85')
Oct 30 09:19:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Deleting instance files /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd_del
Oct 30 09:19:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Deletion of /opt/stack/data/nova/instances/df215875-673c-4446-afa1-3446ff63edbd_del complete
Oct 30 09:19:55 user nova-compute[75017]: INFO nova.compute.manager [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] [instance: df215875-673c-4446-afa1-3446ff63edbd] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 30 09:19:55 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: df215875-673c-4446-afa1-3446ff63edbd] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: df215875-673c-4446-afa1-3446ff63edbd] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:19:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: df215875-673c-4446-afa1-3446ff63edbd] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:19:56 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: df215875-673c-4446-afa1-3446ff63edbd] Took 1.35 seconds to deallocate network for instance.
Oct 30 09:19:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-06972ef4-370b-488d-a057-18d500258103 req-b6ef7fbe-6691-405e-aebb-f668b404d315 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received event network-vif-plugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-06972ef4-370b-488d-a057-18d500258103 req-b6ef7fbe-6691-405e-aebb-f668b404d315 service nova] Acquiring lock "df215875-673c-4446-afa1-3446ff63edbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-06972ef4-370b-488d-a057-18d500258103 req-b6ef7fbe-6691-405e-aebb-f668b404d315 service nova] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-06972ef4-370b-488d-a057-18d500258103 req-b6ef7fbe-6691-405e-aebb-f668b404d315 service nova] Lock "df215875-673c-4446-afa1-3446ff63edbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-06972ef4-370b-488d-a057-18d500258103 req-b6ef7fbe-6691-405e-aebb-f668b404d315 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] No waiting events found dispatching network-vif-plugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:19:56 user nova-compute[75017]: WARNING nova.compute.manager [req-06972ef4-370b-488d-a057-18d500258103 req-b6ef7fbe-6691-405e-aebb-f668b404d315 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received unexpected event network-vif-plugged-f928f8ba-850a-4a21-8553-ab2c3860c8a7 for instance with vm_state deleted and task_state None.
Oct 30 09:19:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-06972ef4-370b-488d-a057-18d500258103 req-b6ef7fbe-6691-405e-aebb-f668b404d315 service nova] [instance: df215875-673c-4446-afa1-3446ff63edbd] Received event network-vif-deleted-f928f8ba-850a-4a21-8553-ab2c3860c8a7 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:19:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:57 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Deleted allocations for instance df215875-673c-4446-afa1-3446ff63edbd
Oct 30 09:19:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ed88ce8-e3e3-45bf-91ef-4e2adc104e08 tempest-TestVolumeSwap-144653908 tempest-TestVolumeSwap-144653908-project-member] Lock "df215875-673c-4446-afa1-3446ff63edbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.911s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:57 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:19:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:57 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:19:57 user nova-compute[75017]: INFO nova.compute.claims [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Claim successful on node user
Oct 30 09:19:58 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:19:58 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:19:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG nova.policy [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'edd9037b1ceb4b899f6d446b565a6ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4606fc32534a589e07baa3a4e76d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:19:58 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Creating image(s)
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "/opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "/opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk 1073741824" returned: 0 in 0.053s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:19:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.168s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Successfully created port: 7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Cannot resize image /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Ensure instance console log exists: /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:19:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Successfully updated port: 7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "refresh_cache-4e5fb05a-f223-414e-ba47-cab136ac7ed1" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquired lock "refresh_cache-4e5fb05a-f223-414e-ba47-cab136ac7ed1" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-26771ce2-957d-4eca-8e03-79a6cace6021 req-2bfcadb9-aadc-4636-9c9f-3eea2dbaf0ba service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received event network-changed-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-26771ce2-957d-4eca-8e03-79a6cace6021 req-2bfcadb9-aadc-4636-9c9f-3eea2dbaf0ba service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Refreshing instance network info cache due to event network-changed-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-26771ce2-957d-4eca-8e03-79a6cace6021 req-2bfcadb9-aadc-4636-9c9f-3eea2dbaf0ba service nova] Acquiring lock "refresh_cache-4e5fb05a-f223-414e-ba47-cab136ac7ed1" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquiring lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:20:00 user nova-compute[75017]: INFO nova.compute.claims [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Claim successful on node user
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Updating instance_info_cache with network_info: [{"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Releasing lock "refresh_cache-4e5fb05a-f223-414e-ba47-cab136ac7ed1" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Instance network_info: |[{"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-26771ce2-957d-4eca-8e03-79a6cace6021 req-2bfcadb9-aadc-4636-9c9f-3eea2dbaf0ba service nova] Acquired lock "refresh_cache-4e5fb05a-f223-414e-ba47-cab136ac7ed1" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-26771ce2-957d-4eca-8e03-79a6cace6021 req-2bfcadb9-aadc-4636-9c9f-3eea2dbaf0ba service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Refreshing network info cache for port 7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Start _get_guest_xml network_info=[{"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:20:00 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:20:00 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1793367976',display_name='tempest-AttachVolumeNegativeTest-server-1793367976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1793367976',id=22,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNkwAOdHpb4wYEHHARSgB3vJvO2zAJ6dl+2K+fp6vwDWbZgOstML+OGIJ1viz78SXMHlaDk7YxbjTo/m6xWJWg9lDRw/uDaX8y2ub7MUBmeSziQjcVlZalqCuUPuhtn7g==',key_name='tempest-keypair-934795787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-crn8k4xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:19:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=4e5fb05a-f223-414e-ba47-cab136ac7ed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4a:3a,bridge_name='br-int',has_traffic_filtering=True,id=7f8eff9f-a7d9-45ca-864c-3ee50b304ea5,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8eff9f-a7') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.objects.instance [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e5fb05a-f223-414e-ba47-cab136ac7ed1 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:20:00 user nova-compute[75017]:   <uuid>4e5fb05a-f223-414e-ba47-cab136ac7ed1</uuid>
Oct 30 09:20:00 user nova-compute[75017]:   <name>instance-00000016</name>
Oct 30 09:20:00 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:20:00 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:20:00 user nova-compute[75017]:   <metadata>
Oct 30 09:20:00 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:20:00 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:20:00 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1793367976</nova:name>
Oct 30 09:20:00 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:20:00</nova:creationTime>
Oct 30 09:20:00 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:20:00 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:20:00 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:20:00 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:20:00 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:20:00 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:20:00 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:20:00 user nova-compute[75017]:       <nova:owner>
Oct 30 09:20:00 user nova-compute[75017]:         <nova:user uuid="edd9037b1ceb4b899f6d446b565a6ff9">tempest-AttachVolumeNegativeTest-63898760-project-member</nova:user>
Oct 30 09:20:00 user nova-compute[75017]:         <nova:project uuid="2a4606fc32534a589e07baa3a4e76d48">tempest-AttachVolumeNegativeTest-63898760</nova:project>
Oct 30 09:20:00 user nova-compute[75017]:       </nova:owner>
Oct 30 09:20:00 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:20:00 user nova-compute[75017]:       <nova:ports>
Oct 30 09:20:00 user nova-compute[75017]:         <nova:port uuid="7f8eff9f-a7d9-45ca-864c-3ee50b304ea5">
Oct 30 09:20:00 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:20:00 user nova-compute[75017]:         </nova:port>
Oct 30 09:20:00 user nova-compute[75017]:       </nova:ports>
Oct 30 09:20:00 user nova-compute[75017]:     </nova:instance>
Oct 30 09:20:00 user nova-compute[75017]:   </metadata>
Oct 30 09:20:00 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:20:00 user nova-compute[75017]:     <system>
Oct 30 09:20:00 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:20:00 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:20:00 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:20:00 user nova-compute[75017]:       <entry name="serial">4e5fb05a-f223-414e-ba47-cab136ac7ed1</entry>
Oct 30 09:20:00 user nova-compute[75017]:       <entry name="uuid">4e5fb05a-f223-414e-ba47-cab136ac7ed1</entry>
Oct 30 09:20:00 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:20:00 user nova-compute[75017]:     </system>
Oct 30 09:20:00 user nova-compute[75017]:   </sysinfo>
Oct 30 09:20:00 user nova-compute[75017]:   <os>
Oct 30 09:20:00 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:20:00 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:20:00 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:20:00 user nova-compute[75017]:   </os>
Oct 30 09:20:00 user nova-compute[75017]:   <features>
Oct 30 09:20:00 user nova-compute[75017]:     <acpi/>
Oct 30 09:20:00 user nova-compute[75017]:     <apic/>
Oct 30 09:20:00 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:20:00 user nova-compute[75017]:   </features>
Oct 30 09:20:00 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:20:00 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:20:00 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:20:00 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:20:00 user nova-compute[75017]:   </clock>
Oct 30 09:20:00 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:20:00 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:20:00 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:20:00 user nova-compute[75017]:   </cpu>
Oct 30 09:20:00 user nova-compute[75017]:   <devices>
Oct 30 09:20:00 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:20:00 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:20:00 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk"/>
Oct 30 09:20:00 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:20:00 user nova-compute[75017]:     </disk>
Oct 30 09:20:00 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:20:00 user nova-compute[75017]:       <mac address="fa:16:3e:2a:4a:3a"/>
Oct 30 09:20:00 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:20:00 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:20:00 user nova-compute[75017]:       <target dev="tap7f8eff9f-a7"/>
Oct 30 09:20:00 user nova-compute[75017]:     </interface>
Oct 30 09:20:00 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:20:00 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/console.log" append="off"/>
Oct 30 09:20:00 user nova-compute[75017]:     </serial>
Oct 30 09:20:00 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:20:00 user nova-compute[75017]:     <video>
Oct 30 09:20:00 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:20:00 user nova-compute[75017]:     </video>
Oct 30 09:20:00 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:20:00 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:20:00 user nova-compute[75017]:     </rng>
Oct 30 09:20:00 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:20:00 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:20:00 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:20:00 user nova-compute[75017]:     </memballoon>
Oct 30 09:20:00 user nova-compute[75017]:   </devices>
Oct 30 09:20:00 user nova-compute[75017]: </domain>
Oct 30 09:20:00 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1793367976',display_name='tempest-AttachVolumeNegativeTest-server-1793367976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1793367976',id=22,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNkwAOdHpb4wYEHHARSgB3vJvO2zAJ6dl+2K+fp6vwDWbZgOstML+OGIJ1viz78SXMHlaDk7YxbjTo/m6xWJWg9lDRw/uDaX8y2ub7MUBmeSziQjcVlZalqCuUPuhtn7g==',key_name='tempest-keypair-934795787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-crn8k4xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:19:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=4e5fb05a-f223-414e-ba47-cab136ac7ed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4a:3a,bridge_name='br-int',has_traffic_filtering=True,id=7f8eff9f-a7d9-45ca-864c-3ee50b304ea5,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8eff9f-a7') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG os_vif [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4a:3a,bridge_name='br-int',has_traffic_filtering=True,id=7f8eff9f-a7d9-45ca-864c-3ee50b304ea5,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8eff9f-a7') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cab4fb7-2330-582c-8b93-1f7cc49c8f51', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f8eff9f-a7, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f8eff9f-a7, col_values=(('qos', UUID('ab605e02-ffa3-47e6-bb8c-14a0a7c10f0f')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f8eff9f-a7, col_values=(('external_ids', {'iface-id': '7f8eff9f-a7d9-45ca-864c-3ee50b304ea5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:4a:3a', 'vm-uuid': '4e5fb05a-f223-414e-ba47-cab136ac7ed1'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:00 user nova-compute[75017]: INFO os_vif [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4a:3a,bridge_name='br-int',has_traffic_filtering=True,id=7f8eff9f-a7d9-45ca-864c-3ee50b304ea5,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8eff9f-a7')
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No VIF found with MAC fa:16:3e:2a:4a:3a, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-26771ce2-957d-4eca-8e03-79a6cace6021 req-2bfcadb9-aadc-4636-9c9f-3eea2dbaf0ba service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Updated VIF entry in instance network info cache for port 7f8eff9f-a7d9-45ca-864c-3ee50b304ea5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-26771ce2-957d-4eca-8e03-79a6cace6021 req-2bfcadb9-aadc-4636-9c9f-3eea2dbaf0ba service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Updating instance_info_cache with network_info: [{"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:20:00 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-26771ce2-957d-4eca-8e03-79a6cace6021 req-2bfcadb9-aadc-4636-9c9f-3eea2dbaf0ba service nova] Releasing lock "refresh_cache-4e5fb05a-f223-414e-ba47-cab136ac7ed1" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:20:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:20:01 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG nova.policy [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdaba7a0836f416f80f3ef623086e846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2e7142d36264f0cbb7a35a88b2fa0e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:20:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Creating image(s)
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquiring lock "/opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "/opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "/opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk 1073741824" returned: 0 in 0.056s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:20:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Successfully created port: d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Cannot resize image /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Ensure instance console log exists: /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-1400a208-ce6b-4ba8-86aa-f82ed357fd3f req-dc82313c-d8c9-4c29-9484-aa462bb6a2eb service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received event network-vif-plugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1400a208-ce6b-4ba8-86aa-f82ed357fd3f req-dc82313c-d8c9-4c29-9484-aa462bb6a2eb service nova] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1400a208-ce6b-4ba8-86aa-f82ed357fd3f req-dc82313c-d8c9-4c29-9484-aa462bb6a2eb service nova] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1400a208-ce6b-4ba8-86aa-f82ed357fd3f req-dc82313c-d8c9-4c29-9484-aa462bb6a2eb service nova] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-1400a208-ce6b-4ba8-86aa-f82ed357fd3f req-dc82313c-d8c9-4c29-9484-aa462bb6a2eb service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] No waiting events found dispatching network-vif-plugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:20:02 user nova-compute[75017]: WARNING nova.compute.manager [req-1400a208-ce6b-4ba8-86aa-f82ed357fd3f req-dc82313c-d8c9-4c29-9484-aa462bb6a2eb service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received unexpected event network-vif-plugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 for instance with vm_state building and task_state spawning.
Oct 30 09:20:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Successfully updated port: d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquiring lock "refresh_cache-32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquired lock "refresh_cache-32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Updating instance_info_cache with network_info: [{"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Releasing lock "refresh_cache-32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Instance network_info: |[{"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Start _get_guest_xml network_info=[{"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:20:03 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:20:03 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-96189984',display_name='tempest-VolumesNegativeTest-instance-96189984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-96189984',id=23,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2e7142d36264f0cbb7a35a88b2fa0e4',ramdisk_id='',reservation_id='r-lqjszwzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-740642040',owner_user_name='tempest-VolumesNegativeTest-740642040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:20:01Z,user_data=None,user_id='fdaba7a0836f416f80f3ef623086e846',uuid=32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Converting VIF {"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=d58d70d1-0b27-4b1d-8afc-b147eefd4226,network=Network(5e84095f-4781-40a4-b0e4-8816fa176bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d70d1-0b') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.objects.instance [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lazy-loading 'pci_devices' on Instance uuid 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:20:03 user nova-compute[75017]:   <uuid>32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e</uuid>
Oct 30 09:20:03 user nova-compute[75017]:   <name>instance-00000017</name>
Oct 30 09:20:03 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:20:03 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:20:03 user nova-compute[75017]:   <metadata>
Oct 30 09:20:03 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:20:03 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:20:03 user nova-compute[75017]:       <nova:name>tempest-VolumesNegativeTest-instance-96189984</nova:name>
Oct 30 09:20:03 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:20:03</nova:creationTime>
Oct 30 09:20:03 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:20:03 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:20:03 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:20:03 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:20:03 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:20:03 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:20:03 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:20:03 user nova-compute[75017]:       <nova:owner>
Oct 30 09:20:03 user nova-compute[75017]:         <nova:user uuid="fdaba7a0836f416f80f3ef623086e846">tempest-VolumesNegativeTest-740642040-project-member</nova:user>
Oct 30 09:20:03 user nova-compute[75017]:         <nova:project uuid="e2e7142d36264f0cbb7a35a88b2fa0e4">tempest-VolumesNegativeTest-740642040</nova:project>
Oct 30 09:20:03 user nova-compute[75017]:       </nova:owner>
Oct 30 09:20:03 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:20:03 user nova-compute[75017]:       <nova:ports>
Oct 30 09:20:03 user nova-compute[75017]:         <nova:port uuid="d58d70d1-0b27-4b1d-8afc-b147eefd4226">
Oct 30 09:20:03 user nova-compute[75017]:           <nova:ip type="fixed" address="192.168.233.192" ipVersion="4"/>
Oct 30 09:20:03 user nova-compute[75017]:         </nova:port>
Oct 30 09:20:03 user nova-compute[75017]:       </nova:ports>
Oct 30 09:20:03 user nova-compute[75017]:     </nova:instance>
Oct 30 09:20:03 user nova-compute[75017]:   </metadata>
Oct 30 09:20:03 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:20:03 user nova-compute[75017]:     <system>
Oct 30 09:20:03 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:20:03 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:20:03 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:20:03 user nova-compute[75017]:       <entry name="serial">32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e</entry>
Oct 30 09:20:03 user nova-compute[75017]:       <entry name="uuid">32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e</entry>
Oct 30 09:20:03 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:20:03 user nova-compute[75017]:     </system>
Oct 30 09:20:03 user nova-compute[75017]:   </sysinfo>
Oct 30 09:20:03 user nova-compute[75017]:   <os>
Oct 30 09:20:03 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:20:03 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:20:03 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:20:03 user nova-compute[75017]:   </os>
Oct 30 09:20:03 user nova-compute[75017]:   <features>
Oct 30 09:20:03 user nova-compute[75017]:     <acpi/>
Oct 30 09:20:03 user nova-compute[75017]:     <apic/>
Oct 30 09:20:03 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:20:03 user nova-compute[75017]:   </features>
Oct 30 09:20:03 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:20:03 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:20:03 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:20:03 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:20:03 user nova-compute[75017]:   </clock>
Oct 30 09:20:03 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:20:03 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:20:03 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:20:03 user nova-compute[75017]:   </cpu>
Oct 30 09:20:03 user nova-compute[75017]:   <devices>
Oct 30 09:20:03 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:20:03 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:20:03 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk"/>
Oct 30 09:20:03 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:20:03 user nova-compute[75017]:     </disk>
Oct 30 09:20:03 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:20:03 user nova-compute[75017]:       <mac address="fa:16:3e:3c:f9:02"/>
Oct 30 09:20:03 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:20:03 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:20:03 user nova-compute[75017]:       <target dev="tapd58d70d1-0b"/>
Oct 30 09:20:03 user nova-compute[75017]:     </interface>
Oct 30 09:20:03 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:20:03 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/console.log" append="off"/>
Oct 30 09:20:03 user nova-compute[75017]:     </serial>
Oct 30 09:20:03 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:20:03 user nova-compute[75017]:     <video>
Oct 30 09:20:03 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:20:03 user nova-compute[75017]:     </video>
Oct 30 09:20:03 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:20:03 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:20:03 user nova-compute[75017]:     </rng>
Oct 30 09:20:03 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:20:03 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:20:03 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:20:03 user nova-compute[75017]:     </memballoon>
Oct 30 09:20:03 user nova-compute[75017]:   </devices>
Oct 30 09:20:03 user nova-compute[75017]: </domain>
Oct 30 09:20:03 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-96189984',display_name='tempest-VolumesNegativeTest-instance-96189984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-96189984',id=23,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2e7142d36264f0cbb7a35a88b2fa0e4',ramdisk_id='',reservation_id='r-lqjszwzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-740642040',owner_user_name='tempest-VolumesNegativeTest-740642040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:20:01Z,user_data=None,user_id='fdaba7a0836f416f80f3ef623086e846',uuid=32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Converting VIF {"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=d58d70d1-0b27-4b1d-8afc-b147eefd4226,network=Network(5e84095f-4781-40a4-b0e4-8816fa176bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d70d1-0b') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG os_vif [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=d58d70d1-0b27-4b1d-8afc-b147eefd4226,network=Network(5e84095f-4781-40a4-b0e4-8816fa176bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d70d1-0b') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c62bcc43-6707-5f4f-bfdf-27253276e157', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd58d70d1-0b, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd58d70d1-0b, col_values=(('qos', UUID('4b3975f1-0bd0-4f37-a592-39eec2d9b5e4')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd58d70d1-0b, col_values=(('external_ids', {'iface-id': 'd58d70d1-0b27-4b1d-8afc-b147eefd4226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:f9:02', 'vm-uuid': '32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:03 user nova-compute[75017]: INFO os_vif [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=d58d70d1-0b27-4b1d-8afc-b147eefd4226,network=Network(5e84095f-4781-40a4-b0e4-8816fa176bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d70d1-0b')
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:20:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] No VIF found with MAC fa:16:3e:3c:f9:02, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:20:04 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Instance spawned successfully.
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:04 user nova-compute[75017]: INFO nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Took 5.96 seconds to spawn the instance on the hypervisor.
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received event network-vif-plugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] No waiting events found dispatching network-vif-plugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:20:04 user nova-compute[75017]: WARNING nova.compute.manager [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received unexpected event network-vif-plugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 for instance with vm_state building and task_state spawning.
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received event network-changed-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Refreshing instance network info cache due to event network-changed-d58d70d1-0b27-4b1d-8afc-b147eefd4226. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] Acquiring lock "refresh_cache-32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] Acquired lock "refresh_cache-32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.network.neutron [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Refreshing network info cache for port d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:20:04 user nova-compute[75017]: INFO nova.compute.manager [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Took 6.74 seconds to build instance.
Oct 30 09:20:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43ad58ad-77ee-4f7c-8e71-e5423edd407f tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.836s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.network.neutron [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Updated VIF entry in instance network info cache for port d58d70d1-0b27-4b1d-8afc-b147eefd4226. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG nova.network.neutron [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Updating instance_info_cache with network_info: [{"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-af77bbaf-c45c-4205-9109-58912f1ecc8d req-0fcf967f-6b07-4adf-9958-1aeac82bc888 service nova] Releasing lock "refresh_cache-32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:20:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received event network-vif-plugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] Acquiring lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] No waiting events found dispatching network-vif-plugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:20:06 user nova-compute[75017]: WARNING nova.compute.manager [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received unexpected event network-vif-plugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 for instance with vm_state building and task_state spawning.
Oct 30 09:20:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received event network-vif-plugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] Acquiring lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] No waiting events found dispatching network-vif-plugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:20:06 user nova-compute[75017]: WARNING nova.compute.manager [req-3e44ec72-517a-40b5-8fc2-bff1d156a42e req-d75a41aa-ee6b-4f59-a39a-2d3d588636fb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received unexpected event network-vif-plugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 for instance with vm_state building and task_state spawning.
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:20:07 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Instance spawned successfully.
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:20:07 user nova-compute[75017]: INFO nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Took 6.24 seconds to spawn the instance on the hypervisor.
Oct 30 09:20:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:20:07 user nova-compute[75017]: INFO nova.compute.manager [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Took 7.26 seconds to build instance.
Oct 30 09:20:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-43c63799-abbc-44e3-98bf-45bb2d8733df tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.353s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "d70af571-8573-4ef5-82e8-9b30084616df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "d70af571-8573-4ef5-82e8-9b30084616df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "d70af571-8573-4ef5-82e8-9b30084616df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:11 user nova-compute[75017]: INFO nova.compute.manager [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Terminating instance
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-b2840973-ab76-424d-b7e2-995295192901 req-88e0b6c5-75e2-43ea-ba9c-622dc22ae135 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received event network-vif-unplugged-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b2840973-ab76-424d-b7e2-995295192901 req-88e0b6c5-75e2-43ea-ba9c-622dc22ae135 service nova] Acquiring lock "d70af571-8573-4ef5-82e8-9b30084616df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b2840973-ab76-424d-b7e2-995295192901 req-88e0b6c5-75e2-43ea-ba9c-622dc22ae135 service nova] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b2840973-ab76-424d-b7e2-995295192901 req-88e0b6c5-75e2-43ea-ba9c-622dc22ae135 service nova] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-b2840973-ab76-424d-b7e2-995295192901 req-88e0b6c5-75e2-43ea-ba9c-622dc22ae135 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] No waiting events found dispatching network-vif-unplugged-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-b2840973-ab76-424d-b7e2-995295192901 req-88e0b6c5-75e2-43ea-ba9c-622dc22ae135 service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received event network-vif-unplugged-2e242288-e4f1-4f5b-a894-0116273c5757 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:11 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Instance destroyed successfully.
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.objects.instance [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lazy-loading 'resources' on Instance uuid d70af571-8573-4ef5-82e8-9b30084616df {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-864812062',display_name='tempest-VolumesActionsTest-instance-864812062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-864812062',id=18,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcd17cc193aa4827b94888db619cf93f',ramdisk_id='',reservation_id='r-0z53074z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1324925892',owner_user_name='tempest-VolumesActionsTest-1324925892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:18:28Z,user_data=None,user_id='41bade78e9b24a15ab4016dc76a20931',uuid=d70af571-8573-4ef5-82e8-9b30084616df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e242288-e4f1-4f5b-a894-0116273c5757", "address": "fa:16:3e:9e:05:e3", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e242288-e4", "ovs_interfaceid": "2e242288-e4f1-4f5b-a894-0116273c5757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converting VIF {"id": "2e242288-e4f1-4f5b-a894-0116273c5757", "address": "fa:16:3e:9e:05:e3", "network": {"id": "1ce61d9a-278e-4d82-b0cd-d3491e1bc298", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979991623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd17cc193aa4827b94888db619cf93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e242288-e4", "ovs_interfaceid": "2e242288-e4f1-4f5b-a894-0116273c5757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:e3,bridge_name='br-int',has_traffic_filtering=True,id=2e242288-e4f1-4f5b-a894-0116273c5757,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e242288-e4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG os_vif [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:e3,bridge_name='br-int',has_traffic_filtering=True,id=2e242288-e4f1-4f5b-a894-0116273c5757,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e242288-e4') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e242288-e4, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83e5895d-562e-43e5-9fb0-b6ab7c3a7389) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: INFO os_vif [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:e3,bridge_name='br-int',has_traffic_filtering=True,id=2e242288-e4f1-4f5b-a894-0116273c5757,network=Network(1ce61d9a-278e-4d82-b0cd-d3491e1bc298),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e242288-e4')
Oct 30 09:20:11 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Deleting instance files /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df_del
Oct 30 09:20:11 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Deletion of /opt/stack/data/nova/instances/d70af571-8573-4ef5-82e8-9b30084616df_del complete
Oct 30 09:20:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:11 user nova-compute[75017]: INFO nova.compute.manager [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Took 0.76 seconds to destroy the instance on the hypervisor.
Oct 30 09:20:11 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:20:11 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: d70af571-8573-4ef5-82e8-9b30084616df] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-001f3016-9940-4770-aa6b-c566dd280e24 req-2ed19e10-2978-4073-b8f1-fd0b7fdc645b service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received event network-vif-deleted-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:12 user nova-compute[75017]: INFO nova.compute.manager [req-001f3016-9940-4770-aa6b-c566dd280e24 req-2ed19e10-2978-4073-b8f1-fd0b7fdc645b service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Neutron deleted interface 2e242288-e4f1-4f5b-a894-0116273c5757; detaching it from the instance and deleting it from the info cache
Oct 30 09:20:12 user nova-compute[75017]: DEBUG nova.network.neutron [req-001f3016-9940-4770-aa6b-c566dd280e24 req-2ed19e10-2978-4073-b8f1-fd0b7fdc645b service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:20:12 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Took 0.54 seconds to deallocate network for instance.
Oct 30 09:20:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-001f3016-9940-4770-aa6b-c566dd280e24 req-2ed19e10-2978-4073-b8f1-fd0b7fdc645b service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Detach interface failed, port_id=2e242288-e4f1-4f5b-a894-0116273c5757, reason: Instance d70af571-8573-4ef5-82e8-9b30084616df could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.390s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:20:12 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Deleted allocations for instance d70af571-8573-4ef5-82e8-9b30084616df
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fbafc134-054b-42c4-9eb1-7ae030475f04 tempest-VolumesActionsTest-1324925892 tempest-VolumesActionsTest-1324925892-project-member] Lock "d70af571-8573-4ef5-82e8-9b30084616df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.959s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG nova.compute.manager [req-ea2e57f3-4ab2-4354-9923-8a6e95868376 req-1b999c1d-858e-4c7c-ae97-2736e657911a service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received event network-vif-plugged-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ea2e57f3-4ab2-4354-9923-8a6e95868376 req-1b999c1d-858e-4c7c-ae97-2736e657911a service nova] Acquiring lock "d70af571-8573-4ef5-82e8-9b30084616df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ea2e57f3-4ab2-4354-9923-8a6e95868376 req-1b999c1d-858e-4c7c-ae97-2736e657911a service nova] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ea2e57f3-4ab2-4354-9923-8a6e95868376 req-1b999c1d-858e-4c7c-ae97-2736e657911a service nova] Lock "d70af571-8573-4ef5-82e8-9b30084616df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG nova.compute.manager [req-ea2e57f3-4ab2-4354-9923-8a6e95868376 req-1b999c1d-858e-4c7c-ae97-2736e657911a service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] No waiting events found dispatching network-vif-plugged-2e242288-e4f1-4f5b-a894-0116273c5757 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:20:13 user nova-compute[75017]: WARNING nova.compute.manager [req-ea2e57f3-4ab2-4354-9923-8a6e95868376 req-1b999c1d-858e-4c7c-ae97-2736e657911a service nova] [instance: d70af571-8573-4ef5-82e8-9b30084616df] Received unexpected event network-vif-plugged-2e242288-e4f1-4f5b-a894-0116273c5757 for instance with vm_state deleted and task_state None.
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:20:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:20:17 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7339MB free_disk=25.371448516845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:20:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 3833002b-0acf-4093-8f10-097760487c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e44fccb6-efe6-461a-91d0-bf1628183258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:20:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-115628d3-b1f1-49da-a439-147eebe4b74a req-d8c462e4-9afb-44ff-8584-5abe79633771 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-changed-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-115628d3-b1f1-49da-a439-147eebe4b74a req-d8c462e4-9afb-44ff-8584-5abe79633771 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Refreshing instance network info cache due to event network-changed-6eb5467b-29cc-4ead-87d9-46828d9a797b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-115628d3-b1f1-49da-a439-147eebe4b74a req-d8c462e4-9afb-44ff-8584-5abe79633771 service nova] Acquiring lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-115628d3-b1f1-49da-a439-147eebe4b74a req-d8c462e4-9afb-44ff-8584-5abe79633771 service nova] Acquired lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-115628d3-b1f1-49da-a439-147eebe4b74a req-d8c462e4-9afb-44ff-8584-5abe79633771 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Refreshing network info cache for port 6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-115628d3-b1f1-49da-a439-147eebe4b74a req-d8c462e4-9afb-44ff-8584-5abe79633771 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updated VIF entry in instance network info cache for port 6eb5467b-29cc-4ead-87d9-46828d9a797b. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-115628d3-b1f1-49da-a439-147eebe4b74a req-d8c462e4-9afb-44ff-8584-5abe79633771 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance_info_cache with network_info: [{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:20:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-115628d3-b1f1-49da-a439-147eebe4b74a req-d8c462e4-9afb-44ff-8584-5abe79633771 service nova] Releasing lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:20:20 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updating instance_info_cache with network_info: [{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:20:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:20:20 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:20:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:20:20 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:20:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-6378b7e9-137f-4839-9c1d-a3477823ddc5 req-5a1be359-56cc-43e5-8e97-804dfa2b43a3 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received event network-changed-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-6378b7e9-137f-4839-9c1d-a3477823ddc5 req-5a1be359-56cc-43e5-8e97-804dfa2b43a3 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Refreshing instance network info cache due to event network-changed-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6378b7e9-137f-4839-9c1d-a3477823ddc5 req-5a1be359-56cc-43e5-8e97-804dfa2b43a3 service nova] Acquiring lock "refresh_cache-5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6378b7e9-137f-4839-9c1d-a3477823ddc5 req-5a1be359-56cc-43e5-8e97-804dfa2b43a3 service nova] Acquired lock "refresh_cache-5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG nova.network.neutron [req-6378b7e9-137f-4839-9c1d-a3477823ddc5 req-5a1be359-56cc-43e5-8e97-804dfa2b43a3 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Refreshing network info cache for port 5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG nova.objects.instance [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'flavor' on Instance uuid 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:20:57 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Ignoring supplied device name: /dev/vdb
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG nova.network.neutron [req-6378b7e9-137f-4839-9c1d-a3477823ddc5 req-5a1be359-56cc-43e5-8e97-804dfa2b43a3 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Updated VIF entry in instance network info cache for port 5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG nova.network.neutron [req-6378b7e9-137f-4839-9c1d-a3477823ddc5 req-5a1be359-56cc-43e5-8e97-804dfa2b43a3 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Updating instance_info_cache with network_info: [{"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6378b7e9-137f-4839-9c1d-a3477823ddc5 req-5a1be359-56cc-43e5-8e97-804dfa2b43a3 service nova] Releasing lock "refresh_cache-5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:20:57 user nova-compute[75017]: INFO nova.compute.manager [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Attaching volume 4551dccb-e3d8-497d-b2e2-96a08326280c to /dev/vdb
Oct 30 09:20:57 user nova-compute[75017]: DEBUG os_brick.utils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4aae35-779d-45b4-8829-0769f6d7b626]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeb2960-16cb-4721-92ab-4ab50f0e9d7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ae0984-a1ca-4e8c-bfa8-ac3e262b3bce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d610012e-b25c-4661-8aaa-422faf7bde1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:20:57 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:20:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c01f4-2845-478d-8cb2-cd9a7b520a29]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG os_brick.utils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:20:57 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Updating existing volume attachment record: e06235e4-9fdb-4bde-a32e-edfe4a258c52 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:20:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:00 user nova-compute[75017]: INFO nova.compute.manager [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Rescuing
Oct 30 09:21:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:21:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquired lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:21:00 user nova-compute[75017]: DEBUG nova.network.neutron [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:21:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG nova.network.neutron [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updating instance_info_cache with network_info: [{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Releasing lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-7dece2c0-c42f-4de0-91e1-38a055cfd480 req-18407e43-d54d-443c-877a-bdf01a2923aa service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-unplugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7dece2c0-c42f-4de0-91e1-38a055cfd480 req-18407e43-d54d-443c-877a-bdf01a2923aa service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7dece2c0-c42f-4de0-91e1-38a055cfd480 req-18407e43-d54d-443c-877a-bdf01a2923aa service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7dece2c0-c42f-4de0-91e1-38a055cfd480 req-18407e43-d54d-443c-877a-bdf01a2923aa service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-7dece2c0-c42f-4de0-91e1-38a055cfd480 req-18407e43-d54d-443c-877a-bdf01a2923aa service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-unplugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:01 user nova-compute[75017]: WARNING nova.compute.manager [req-7dece2c0-c42f-4de0-91e1-38a055cfd480 req-18407e43-d54d-443c-877a-bdf01a2923aa service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-unplugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state active and task_state rescuing.
Oct 30 09:21:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:02 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Instance destroyed successfully.
Oct 30 09:21:02 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Attempting rescue
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75017) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Instance directory exists: not creating {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 09:21:02 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Creating image(s)
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'trusted_certs' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue" returned: 0 in 0.059s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'migration_context' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.base [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<c6aae433-005c-4b50-9006-d71bca0f8368> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Start _get_guest_xml network_info=[{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "vif_mac": "fa:16:3e:53:eb:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'resources' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.base [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<c6aae433-005c-4b50-9006-d71bca0f8368> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'numa_topology' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.base [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<c6aae433-005c-4b50-9006-d71bca0f8368> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:02 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:21:02 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.base [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<c6aae433-005c-4b50-9006-d71bca0f8368> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1708607494',display_name='tempest-ServerRescueNegativeTestJSON-server-1708607494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1708607494',id=13,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:16:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-skov6gww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:16:23Z,user_data=None,user_id='e7b340dac0544150bc642f7ecfb07157',uuid=c6aae433-005c-4b50-9006-d71bca0f8368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "vif_mac": "fa:16:3e:53:eb:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "vif_mac": "fa:16:3e:53:eb:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:eb:56,bridge_name='br-int',has_traffic_filtering=True,id=bc2ab399-b4af-40af-b756-74b48450eb12,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc2ab399-b4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'pci_devices' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.objects.base [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<c6aae433-005c-4b50-9006-d71bca0f8368> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:21:02 user nova-compute[75017]:   <uuid>c6aae433-005c-4b50-9006-d71bca0f8368</uuid>
Oct 30 09:21:02 user nova-compute[75017]:   <name>instance-0000000d</name>
Oct 30 09:21:02 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:21:02 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:21:02 user nova-compute[75017]:   <metadata>
Oct 30 09:21:02 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:21:02 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:21:02 user nova-compute[75017]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1708607494</nova:name>
Oct 30 09:21:02 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:21:02</nova:creationTime>
Oct 30 09:21:02 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:21:02 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:21:02 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:21:02 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:21:02 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:21:02 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:21:02 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:21:02 user nova-compute[75017]:       <nova:owner>
Oct 30 09:21:02 user nova-compute[75017]:         <nova:user uuid="e7b340dac0544150bc642f7ecfb07157">tempest-ServerRescueNegativeTestJSON-1002551965-project-member</nova:user>
Oct 30 09:21:02 user nova-compute[75017]:         <nova:project uuid="8c1e0e03de5c497a94c9c6267e623573">tempest-ServerRescueNegativeTestJSON-1002551965</nova:project>
Oct 30 09:21:02 user nova-compute[75017]:       </nova:owner>
Oct 30 09:21:02 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:21:02 user nova-compute[75017]:       <nova:ports>
Oct 30 09:21:02 user nova-compute[75017]:         <nova:port uuid="bc2ab399-b4af-40af-b756-74b48450eb12">
Oct 30 09:21:02 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 09:21:02 user nova-compute[75017]:         </nova:port>
Oct 30 09:21:02 user nova-compute[75017]:       </nova:ports>
Oct 30 09:21:02 user nova-compute[75017]:     </nova:instance>
Oct 30 09:21:02 user nova-compute[75017]:   </metadata>
Oct 30 09:21:02 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:21:02 user nova-compute[75017]:     <system>
Oct 30 09:21:02 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:21:02 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:21:02 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:21:02 user nova-compute[75017]:       <entry name="serial">c6aae433-005c-4b50-9006-d71bca0f8368</entry>
Oct 30 09:21:02 user nova-compute[75017]:       <entry name="uuid">c6aae433-005c-4b50-9006-d71bca0f8368</entry>
Oct 30 09:21:02 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:21:02 user nova-compute[75017]:     </system>
Oct 30 09:21:02 user nova-compute[75017]:   </sysinfo>
Oct 30 09:21:02 user nova-compute[75017]:   <os>
Oct 30 09:21:02 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:21:02 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:21:02 user nova-compute[75017]:   </os>
Oct 30 09:21:02 user nova-compute[75017]:   <features>
Oct 30 09:21:02 user nova-compute[75017]:     <acpi/>
Oct 30 09:21:02 user nova-compute[75017]:     <apic/>
Oct 30 09:21:02 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:21:02 user nova-compute[75017]:   </features>
Oct 30 09:21:02 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:21:02 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:21:02 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:21:02 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:21:02 user nova-compute[75017]:   </clock>
Oct 30 09:21:02 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:21:02 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:21:02 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:21:02 user nova-compute[75017]:   </cpu>
Oct 30 09:21:02 user nova-compute[75017]:   <devices>
Oct 30 09:21:02 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:21:02 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:21:02 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue"/>
Oct 30 09:21:02 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:21:02 user nova-compute[75017]:     </disk>
Oct 30 09:21:02 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:21:02 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:21:02 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk"/>
Oct 30 09:21:02 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:21:02 user nova-compute[75017]:     </disk>
Oct 30 09:21:02 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:21:02 user nova-compute[75017]:       <mac address="fa:16:3e:53:eb:56"/>
Oct 30 09:21:02 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:21:02 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:21:02 user nova-compute[75017]:       <target dev="tapbc2ab399-b4"/>
Oct 30 09:21:02 user nova-compute[75017]:     </interface>
Oct 30 09:21:02 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:21:02 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/console.log" append="off"/>
Oct 30 09:21:02 user nova-compute[75017]:     </serial>
Oct 30 09:21:02 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:21:02 user nova-compute[75017]:     <video>
Oct 30 09:21:02 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:21:02 user nova-compute[75017]:     </video>
Oct 30 09:21:02 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:21:02 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:21:02 user nova-compute[75017]:     </rng>
Oct 30 09:21:02 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:21:02 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:21:02 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:21:02 user nova-compute[75017]:     </memballoon>
Oct 30 09:21:02 user nova-compute[75017]:   </devices>
Oct 30 09:21:02 user nova-compute[75017]: </domain>
Oct 30 09:21:02 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:21:02 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Instance destroyed successfully.
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No VIF found with MAC fa:16:3e:53:eb:56, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:21:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-15fe4ba7-7bcc-4511-a416-3c3674ce24ef req-9b4c2a26-a772-48b6-a76f-107cabc4fb87 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-15fe4ba7-7bcc-4511-a416-3c3674ce24ef req-9b4c2a26-a772-48b6-a76f-107cabc4fb87 service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-15fe4ba7-7bcc-4511-a416-3c3674ce24ef req-9b4c2a26-a772-48b6-a76f-107cabc4fb87 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-15fe4ba7-7bcc-4511-a416-3c3674ce24ef req-9b4c2a26-a772-48b6-a76f-107cabc4fb87 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-15fe4ba7-7bcc-4511-a416-3c3674ce24ef req-9b4c2a26-a772-48b6-a76f-107cabc4fb87 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:03 user nova-compute[75017]: WARNING nova.compute.manager [req-15fe4ba7-7bcc-4511-a416-3c3674ce24ef req-9b4c2a26-a772-48b6-a76f-107cabc4fb87 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state active and task_state rescuing.
Oct 30 09:21:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:05 user nova-compute[75017]: WARNING nova.compute.manager [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state active and task_state rescuing.
Oct 30 09:21:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:05 user nova-compute[75017]: WARNING nova.compute.manager [req-812cfe2a-1d72-40eb-8523-315754b7c347 req-30b9df6f-a680-47b1-8b29-99f2bdebbc9f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state active and task_state rescuing.
Oct 30 09:21:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-555648b1-d7ed-42d1-ace1-908514a6c3f0 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:21:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:11 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:21:11 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:21:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:12 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:21:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:21:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json" returned: 0 in 0.340s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'flavor' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.130s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:17 user nova-compute[75017]: INFO nova.compute.manager [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Attaching volume 7575e8ce-b5de-4c95-b017-0d73b0113361 to /dev/vdb
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG os_brick.utils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9497611a-b0ec-40b4-ac3f-5901eef1bd8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2efe132-f647-494e-b710-fb14c4078104]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0d0c18-dc38-4c73-8d17-e37e6765c4ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d99c88d-21ce-4298-a1c5-f84913ffa119]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:21:17 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ea7d1-9179-4e09-9e2b-fb620c1a176e]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG os_brick.utils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating existing volume attachment record: a0bba5af-7c84-411b-aeaa-ee305a1a3454 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:18 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:21:18 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:21:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=25.302528381347656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:21:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:18 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 3833002b-0acf-4093-8f10-097760487c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e44fccb6-efe6-461a-91d0-bf1628183258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:21:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BucYlqxf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:21:21 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:21:21 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:21:21 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c980db6-c08e-44c4-b226-16cdbdd0abc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:21:21 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b41ee8c-2d9b-49b7-8d79-e1bad45eaef9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c] added
Oct 30 09:21:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[00026ce2-c5b4-4340-abb0-be0fc0dd5e42]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb6c374-2859-42bf-b277-6033d710a8e0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BucYlqxf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BucYlqxf" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad3b659-d50f-43ba-981d-17bb6c256f6d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BucYlqxf'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ab3fdb-1905-45dc-bb09-dca8d983d2cc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a554d21-6599-47f2-93ef-0a7e7f05d8ec]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6088b1b6-625a-4088-bc65-d729637d4262]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c, portal: 172.16.0.220,3260]
Oct 30 09:21:21 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c, portal: 172.16.0.220,3260] successful.
Oct 30 09:21:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae63170-92a1-4bd8-a4c5-e49e94934409]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc03f348-c392-4094-9d0a-47fc40c8ef19]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:21 user nova-compute[75017]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:21 user nova-compute[75017]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10dd91a-ccbb-4104-93d5-45f3620f6f72]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:21:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updating instance_info_cache with network_info: [{"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BucYlqxf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23935653537323961', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935653537323961', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG nova.objects.instance [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'flavor' on Instance uuid 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:21:22 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:21:22 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:21:22 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:21:22 user nova-compute[75017]:   <serial>4551dccb-e3d8-497d-b2e2-96a08326280c</serial>
Oct 30 09:21:22 user nova-compute[75017]: </disk>
Oct 30 09:21:22 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:21:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No VIF found with MAC fa:16:3e:4d:07:d6, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:21:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-567d3284-fb0d-4363-be81-13e31c1925f9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.612s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "2409e52f-cc2e-470a-87d7-c54d67741d52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:21:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:21:24 user nova-compute[75017]: INFO nova.compute.claims [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Claim successful on node user
Oct 30 09:21:24 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:21:24 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:21:25 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:21:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG nova.policy [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35a9a593584b4225af22375653d9c33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98308afa3b794383aca709bceceae3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:21:25 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Creating image(s)
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "/opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "/opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "/opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.213s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.222s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk 1073741824" returned: 0 in 0.049s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:25 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Successfully created port: cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.218s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Cannot resize image /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Ensure instance console log exists: /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Successfully updated port: cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "refresh_cache-2409e52f-cc2e-470a-87d7-c54d67741d52" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquired lock "refresh_cache-2409e52f-cc2e-470a-87d7-c54d67741d52" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-e1de1f37-0387-44cb-9d40-f05afc4b0834 req-1773c693-3f06-4adf-8cfb-3b858ea60a83 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received event network-changed-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-e1de1f37-0387-44cb-9d40-f05afc4b0834 req-1773c693-3f06-4adf-8cfb-3b858ea60a83 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Refreshing instance network info cache due to event network-changed-cc1a3939-074f-413a-827e-a9c365144018. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e1de1f37-0387-44cb-9d40-f05afc4b0834 req-1773c693-3f06-4adf-8cfb-3b858ea60a83 service nova] Acquiring lock "refresh_cache-2409e52f-cc2e-470a-87d7-c54d67741d52" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:21:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Updating instance_info_cache with network_info: [{"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Releasing lock "refresh_cache-2409e52f-cc2e-470a-87d7-c54d67741d52" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Instance network_info: |[{"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e1de1f37-0387-44cb-9d40-f05afc4b0834 req-1773c693-3f06-4adf-8cfb-3b858ea60a83 service nova] Acquired lock "refresh_cache-2409e52f-cc2e-470a-87d7-c54d67741d52" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.network.neutron [req-e1de1f37-0387-44cb-9d40-f05afc4b0834 req-1773c693-3f06-4adf-8cfb-3b858ea60a83 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Refreshing network info cache for port cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Start _get_guest_xml network_info=[{"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:21:27 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:21:27 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1911679650',display_name='tempest-ServersNegativeTestJSON-server-1911679650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1911679650',id=24,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98308afa3b794383aca709bceceae3a5',ramdisk_id='',reservation_id='r-8p0jd0sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1551770249',owner_user_name='tempest-ServersNegativeTestJSON-1551770249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:25Z,user_data=None,user_id='35a9a593584b4225af22375653d9c33a',uuid=2409e52f-cc2e-470a-87d7-c54d67741d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converting VIF {"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:59,bridge_name='br-int',has_traffic_filtering=True,id=cc1a3939-074f-413a-827e-a9c365144018,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1a3939-07') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.objects.instance [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lazy-loading 'pci_devices' on Instance uuid 2409e52f-cc2e-470a-87d7-c54d67741d52 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:21:27 user nova-compute[75017]:   <uuid>2409e52f-cc2e-470a-87d7-c54d67741d52</uuid>
Oct 30 09:21:27 user nova-compute[75017]:   <name>instance-00000018</name>
Oct 30 09:21:27 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:21:27 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:21:27 user nova-compute[75017]:   <metadata>
Oct 30 09:21:27 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:21:27 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:21:27 user nova-compute[75017]:       <nova:name>tempest-ServersNegativeTestJSON-server-1911679650</nova:name>
Oct 30 09:21:27 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:21:27</nova:creationTime>
Oct 30 09:21:27 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:21:27 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:21:27 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:21:27 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:21:27 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:21:27 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:21:27 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:21:27 user nova-compute[75017]:       <nova:owner>
Oct 30 09:21:27 user nova-compute[75017]:         <nova:user uuid="35a9a593584b4225af22375653d9c33a">tempest-ServersNegativeTestJSON-1551770249-project-member</nova:user>
Oct 30 09:21:27 user nova-compute[75017]:         <nova:project uuid="98308afa3b794383aca709bceceae3a5">tempest-ServersNegativeTestJSON-1551770249</nova:project>
Oct 30 09:21:27 user nova-compute[75017]:       </nova:owner>
Oct 30 09:21:27 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:21:27 user nova-compute[75017]:       <nova:ports>
Oct 30 09:21:27 user nova-compute[75017]:         <nova:port uuid="cc1a3939-074f-413a-827e-a9c365144018">
Oct 30 09:21:27 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 09:21:27 user nova-compute[75017]:         </nova:port>
Oct 30 09:21:27 user nova-compute[75017]:       </nova:ports>
Oct 30 09:21:27 user nova-compute[75017]:     </nova:instance>
Oct 30 09:21:27 user nova-compute[75017]:   </metadata>
Oct 30 09:21:27 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:21:27 user nova-compute[75017]:     <system>
Oct 30 09:21:27 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:21:27 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:21:27 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:21:27 user nova-compute[75017]:       <entry name="serial">2409e52f-cc2e-470a-87d7-c54d67741d52</entry>
Oct 30 09:21:27 user nova-compute[75017]:       <entry name="uuid">2409e52f-cc2e-470a-87d7-c54d67741d52</entry>
Oct 30 09:21:27 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:21:27 user nova-compute[75017]:     </system>
Oct 30 09:21:27 user nova-compute[75017]:   </sysinfo>
Oct 30 09:21:27 user nova-compute[75017]:   <os>
Oct 30 09:21:27 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:21:27 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:21:27 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:21:27 user nova-compute[75017]:   </os>
Oct 30 09:21:27 user nova-compute[75017]:   <features>
Oct 30 09:21:27 user nova-compute[75017]:     <acpi/>
Oct 30 09:21:27 user nova-compute[75017]:     <apic/>
Oct 30 09:21:27 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:21:27 user nova-compute[75017]:   </features>
Oct 30 09:21:27 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:21:27 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:21:27 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:21:27 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:21:27 user nova-compute[75017]:   </clock>
Oct 30 09:21:27 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:21:27 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:21:27 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:21:27 user nova-compute[75017]:   </cpu>
Oct 30 09:21:27 user nova-compute[75017]:   <devices>
Oct 30 09:21:27 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:21:27 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:21:27 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk"/>
Oct 30 09:21:27 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:21:27 user nova-compute[75017]:     </disk>
Oct 30 09:21:27 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:21:27 user nova-compute[75017]:       <mac address="fa:16:3e:cb:cd:59"/>
Oct 30 09:21:27 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:21:27 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:21:27 user nova-compute[75017]:       <target dev="tapcc1a3939-07"/>
Oct 30 09:21:27 user nova-compute[75017]:     </interface>
Oct 30 09:21:27 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:21:27 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/console.log" append="off"/>
Oct 30 09:21:27 user nova-compute[75017]:     </serial>
Oct 30 09:21:27 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:21:27 user nova-compute[75017]:     <video>
Oct 30 09:21:27 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:21:27 user nova-compute[75017]:     </video>
Oct 30 09:21:27 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:21:27 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:21:27 user nova-compute[75017]:     </rng>
Oct 30 09:21:27 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:21:27 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:21:27 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:21:27 user nova-compute[75017]:     </memballoon>
Oct 30 09:21:27 user nova-compute[75017]:   </devices>
Oct 30 09:21:27 user nova-compute[75017]: </domain>
Oct 30 09:21:27 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1911679650',display_name='tempest-ServersNegativeTestJSON-server-1911679650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1911679650',id=24,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98308afa3b794383aca709bceceae3a5',ramdisk_id='',reservation_id='r-8p0jd0sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1551770249',owner_user_name='tempest-ServersNegativeTestJSON-1551770249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:25Z,user_data=None,user_id='35a9a593584b4225af22375653d9c33a',uuid=2409e52f-cc2e-470a-87d7-c54d67741d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converting VIF {"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:59,bridge_name='br-int',has_traffic_filtering=True,id=cc1a3939-074f-413a-827e-a9c365144018,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1a3939-07') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG os_vif [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:59,bridge_name='br-int',has_traffic_filtering=True,id=cc1a3939-074f-413a-827e-a9c365144018,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1a3939-07') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e88a4b63-80f7-5c25-ae04-7dd4a0960162', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc1a3939-07, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc1a3939-07, col_values=(('qos', UUID('93827a6d-08aa-4cf8-8890-a3ab48a29866')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc1a3939-07, col_values=(('external_ids', {'iface-id': 'cc1a3939-074f-413a-827e-a9c365144018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:cd:59', 'vm-uuid': '2409e52f-cc2e-470a-87d7-c54d67741d52'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:27 user nova-compute[75017]: INFO os_vif [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:59,bridge_name='br-int',has_traffic_filtering=True,id=cc1a3939-074f-413a-827e-a9c365144018,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1a3939-07')
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] No VIF found with MAC fa:16:3e:cb:cd:59, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.network.neutron [req-e1de1f37-0387-44cb-9d40-f05afc4b0834 req-1773c693-3f06-4adf-8cfb-3b858ea60a83 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Updated VIF entry in instance network info cache for port cc1a3939-074f-413a-827e-a9c365144018. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG nova.network.neutron [req-e1de1f37-0387-44cb-9d40-f05afc4b0834 req-1773c693-3f06-4adf-8cfb-3b858ea60a83 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Updating instance_info_cache with network_info: [{"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:21:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e1de1f37-0387-44cb-9d40-f05afc4b0834 req-1773c693-3f06-4adf-8cfb-3b858ea60a83 service nova] Releasing lock "refresh_cache-2409e52f-cc2e-470a-87d7-c54d67741d52" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:28 user nova-compute[75017]: INFO nova.compute.manager [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Detaching volume 76578c94-dbfd-4ae7-a51e-d1113879fc14
Oct 30 09:21:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:28 user nova-compute[75017]: INFO nova.virt.block_device [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Attempting to driver detach volume 76578c94-dbfd-4ae7-a51e-d1113879fc14 from mountpoint /dev/vdb
Oct 30 09:21:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Attempting to detach device vdb from instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:21:28 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:21:28 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:21:28 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:21:28 user nova-compute[75017]:   <serial>76578c94-dbfd-4ae7-a51e-d1113879fc14</serial>
Oct 30 09:21:28 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 09:21:28 user nova-compute[75017]: </disk>
Oct 30 09:21:28 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:21:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully detached device vdb from instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 from the persistent domain config.
Oct 30 09:21:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:21:28 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:21:28 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:21:28 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:21:28 user nova-compute[75017]:   <serial>76578c94-dbfd-4ae7-a51e-d1113879fc14</serial>
Oct 30 09:21:28 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 09:21:28 user nova-compute[75017]: </disk>
Oct 30 09:21:28 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-2e8b5024-a817-4ef7-81ae-b4ab26daccdd req-9154d200-b0f6-4217-bbac-a6efa68d1998 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received event network-vif-plugged-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2e8b5024-a817-4ef7-81ae-b4ab26daccdd req-9154d200-b0f6-4217-bbac-a6efa68d1998 service nova] Acquiring lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2e8b5024-a817-4ef7-81ae-b4ab26daccdd req-9154d200-b0f6-4217-bbac-a6efa68d1998 service nova] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2e8b5024-a817-4ef7-81ae-b4ab26daccdd req-9154d200-b0f6-4217-bbac-a6efa68d1998 service nova] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-2e8b5024-a817-4ef7-81ae-b4ab26daccdd req-9154d200-b0f6-4217-bbac-a6efa68d1998 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] No waiting events found dispatching network-vif-plugged-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:28 user nova-compute[75017]: WARNING nova.compute.manager [req-2e8b5024-a817-4ef7-81ae-b4ab26daccdd req-9154d200-b0f6-4217-bbac-a6efa68d1998 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received unexpected event network-vif-plugged-cc1a3939-074f-413a-827e-a9c365144018 for instance with vm_state building and task_state spawning.
Oct 30 09:21:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:21:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-e904ea51-8040-4cc0-abc5-41ede6dbee10 req-bb9ed4fd-531d-4096-aaa7-7261231d379e service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received event network-vif-plugged-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e904ea51-8040-4cc0-abc5-41ede6dbee10 req-bb9ed4fd-531d-4096-aaa7-7261231d379e service nova] Acquiring lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e904ea51-8040-4cc0-abc5-41ede6dbee10 req-bb9ed4fd-531d-4096-aaa7-7261231d379e service nova] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e904ea51-8040-4cc0-abc5-41ede6dbee10 req-bb9ed4fd-531d-4096-aaa7-7261231d379e service nova] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-e904ea51-8040-4cc0-abc5-41ede6dbee10 req-bb9ed4fd-531d-4096-aaa7-7261231d379e service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] No waiting events found dispatching network-vif-plugged-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:31 user nova-compute[75017]: WARNING nova.compute.manager [req-e904ea51-8040-4cc0-abc5-41ede6dbee10 req-bb9ed4fd-531d-4096-aaa7-7261231d379e service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received unexpected event network-vif-plugged-cc1a3939-074f-413a-827e-a9c365144018 for instance with vm_state building and task_state spawning.
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:21:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Instance spawned successfully.
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:21:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:21:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:32 user nova-compute[75017]: INFO nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Took 7.15 seconds to spawn the instance on the hypervisor.
Oct 30 09:21:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:21:32 user nova-compute[75017]: INFO nova.compute.manager [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Took 8.37 seconds to build instance.
Oct 30 09:21:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8b05de4c-074a-4d79-8073-cb0602ca1ce7 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.495s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:21:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnApGoTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:21:43 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:21:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:21:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:21:43 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:21:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:21:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:21:43 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:21:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260" returned: 21 in 0.166s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd1d2e3-3e38-4fc8-b24e-564517e7003e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:21:44 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f01a646-ca76-4a9f-b19b-70e5512e0383]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361] added
Oct 30 09:21:44 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc472c9b-f320-4a7c-96f4-a313336dc151]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26d74cd-b1ec-4182-96f6-b672ad505730]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnApGoTL {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnApGoTL" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f951cc-2e7a-4ab4-941f-ef943cfab302]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mnApGoTL'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38904b5-02c0-4d26-9002-1767d72f4177]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1482b1-54d6-4a95-9901-6cd1cb75cf4f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a378ab7e-df7b-43f0-9533-c8b834608e75 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a378ab7e-df7b-43f0-9533-c8b834608e75 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a378ab7e-df7b-43f0-9533-c8b834608e75 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d697e78-4088-48bd-b7e9-f50d9d4e5ba7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361, portal: 172.16.0.220,3260]
Oct 30 09:21:44 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361, portal: 172.16.0.220,3260] successful.
Oct 30 09:21:44 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[211d990b-3022-4262-8b11-f9da764d39ca]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85155fc-40cf-4b59-b72e-fff0d398ffaf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a378ab7e-df7b-43f0-9533-c8b834608e75 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a378ab7e-df7b-43f0-9533-c8b834608e75 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a378ab7e-df7b-43f0-9533-c8b834608e75 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:21:44 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.537s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7987905f-eb96-41c6-9c61-8cd5576c85d3]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:21:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnApGoTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:21:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.597s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:21:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] <== connect_volume: return (1603ms) {'type': 'block', 'scsi_wwn': '23763363434373166', 'path': '/dev/sde'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:21:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763363434373166', 'path': '/dev/sde'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:21:45 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'flavor' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:21:45 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:21:45 user nova-compute[75017]:   <source dev="/dev/sde"/>
Oct 30 09:21:45 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:21:45 user nova-compute[75017]:   <serial>7575e8ce-b5de-4c95-b017-0d73b0113361</serial>
Oct 30 09:21:45 user nova-compute[75017]: </disk>
Oct 30 09:21:45 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:21:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] No VIF found with MAC fa:16:3e:7a:7e:05, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:21:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5d3d1b28-5136-4d49-b154-cb34b0cd99db tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.215s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:48 user nova-compute[75017]: INFO nova.compute.manager [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Rescuing
Oct 30 09:21:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:21:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquired lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:21:48 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:21:48 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:21:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Releasing lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfa811b-afd7-4eba-b9c9-829d21f57e35 req-69e22ce5-98e3-4202-9fc9-be37adfaa61a service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-unplugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfa811b-afd7-4eba-b9c9-829d21f57e35 req-69e22ce5-98e3-4202-9fc9-be37adfaa61a service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfa811b-afd7-4eba-b9c9-829d21f57e35 req-69e22ce5-98e3-4202-9fc9-be37adfaa61a service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfa811b-afd7-4eba-b9c9-829d21f57e35 req-69e22ce5-98e3-4202-9fc9-be37adfaa61a service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfa811b-afd7-4eba-b9c9-829d21f57e35 req-69e22ce5-98e3-4202-9fc9-be37adfaa61a service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-unplugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:49 user nova-compute[75017]: WARNING nova.compute.manager [req-cdfa811b-afd7-4eba-b9c9-829d21f57e35 req-69e22ce5-98e3-4202-9fc9-be37adfaa61a service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-unplugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state active and task_state rescuing.
Oct 30 09:21:49 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 is timed out.
Oct 30 09:21:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully detached device vdb from instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 from the live domain config.
Oct 30 09:21:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sItbzUMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:21:49 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-370659a5-e327-4779-930e-c70f10b05304 req-5d25b77d-575d-4e49-8b29-1581a178cdf0 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received event network-changed-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-370659a5-e327-4779-930e-c70f10b05304 req-5d25b77d-575d-4e49-8b29-1581a178cdf0 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Refreshing instance network info cache due to event network-changed-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-370659a5-e327-4779-930e-c70f10b05304 req-5d25b77d-575d-4e49-8b29-1581a178cdf0 service nova] Acquiring lock "refresh_cache-4e5fb05a-f223-414e-ba47-cab136ac7ed1" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-370659a5-e327-4779-930e-c70f10b05304 req-5d25b77d-575d-4e49-8b29-1581a178cdf0 service nova] Acquired lock "refresh_cache-4e5fb05a-f223-414e-ba47-cab136ac7ed1" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG nova.network.neutron [req-370659a5-e327-4779-930e-c70f10b05304 req-5d25b77d-575d-4e49-8b29-1581a178cdf0 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Refreshing network info cache for port 7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1de340-f7fd-4a5e-bba6-6dafb1f02b59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:21:49 user nova-compute[75017]: No targets found.
Oct 30 09:21:49 user nova-compute[75017]: iSNS:
Oct 30 09:21:49 user nova-compute[75017]: No targets found.
Oct 30 09:21:49 user nova-compute[75017]: STATIC:
Oct 30 09:21:49 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14
Oct 30 09:21:49 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:21:49 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:21:49 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c
Oct 30 09:21:49 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:21:49 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:21:49 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361
Oct 30 09:21:49 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:21:49 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:21:49 user nova-compute[75017]: FIRMWARE:
Oct 30 09:21:49 user nova-compute[75017]: No targets found.
Oct 30 09:21:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:21:49 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:21:49 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b2728-a6ea-4686-8125-9db3b99a4eaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac23a88-1d33-4d1a-b4dc-882d423076e5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:49 user nova-compute[75017]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:49 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:21:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 (non-flash)
Oct 30 09:21:49 user nova-compute[75017]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:49 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:21:49 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd0c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd69a853-425f-4ce6-8df5-5b988ad5fcf9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e129eb9-a67e-426c-91c7-a2fe39937866]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa0ec30-f715-494c-8e74-55e3db10fad1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.148s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0141ba9b-1f53-49e7-9c7b-ff2a21682a1e]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62253fe-2ff3-4bef-8885-76326726a3b3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:49 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 3833002b-0acf-4093-8f10-097760487c73] Instance destroyed successfully.
Oct 30 09:21:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Attempting a stable device rescue
Oct 30 09:21:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b062fcdd-7694-4310-a1ac-e1c9f513685d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260]
Oct 30 09:21:50 user nova-compute[75017]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14, portal: 172.16.0.220,3260] successful.
Oct 30 09:21:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76578c94-dbfd-4ae7-a51e-d1113879fc14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f88c69-da8b-4613-813c-6155451ace51]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.597s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] <== disconnect_volume: return (600ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75017) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Instance directory exists: not creating {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 09:21:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Creating image(s)
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "0bebbd27eccad003710d0331b4eac4e5b1736de4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "0bebbd27eccad003710d0331b4eac4e5b1736de4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:21:50 user nova-compute[75017]: INFO nova.compute.claims [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Claim successful on node user
Oct 30 09:21:50 user nova-compute[75017]: DEBUG nova.network.neutron [req-370659a5-e327-4779-930e-c70f10b05304 req-5d25b77d-575d-4e49-8b29-1581a178cdf0 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Updated VIF entry in instance network info cache for port 7f8eff9f-a7d9-45ca-864c-3ee50b304ea5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG nova.network.neutron [req-370659a5-e327-4779-930e-c70f10b05304 req-5d25b77d-575d-4e49-8b29-1581a178cdf0 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Updating instance_info_cache with network_info: [{"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-370659a5-e327-4779-930e-c70f10b05304 req-5d25b77d-575d-4e49-8b29-1581a178cdf0 service nova] Releasing lock "refresh_cache-4e5fb05a-f223-414e-ba47-cab136ac7ed1" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:21:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lazy-loading 'flavor' on Instance uuid 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-5857eecd-97a4-40c8-826b-ef00da583834 req-bef843f6-1ce6-4c61-9aef-3a546aa9fd53 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5857eecd-97a4-40c8-826b-ef00da583834 req-bef843f6-1ce6-4c61-9aef-3a546aa9fd53 service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5857eecd-97a4-40c8-826b-ef00da583834 req-bef843f6-1ce6-4c61-9aef-3a546aa9fd53 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5857eecd-97a4-40c8-826b-ef00da583834 req-bef843f6-1ce6-4c61-9aef-3a546aa9fd53 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-5857eecd-97a4-40c8-826b-ef00da583834 req-bef843f6-1ce6-4c61-9aef-3a546aa9fd53 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:51 user nova-compute[75017]: WARNING nova.compute.manager [req-5857eecd-97a4-40c8-826b-ef00da583834 req-bef843f6-1ce6-4c61-9aef-3a546aa9fd53 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state active and task_state rescuing.
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquiring lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquiring lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:51 user nova-compute[75017]: INFO nova.compute.manager [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Terminating instance
Oct 30 09:21:51 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b76cf5fe-1cbe-419f-a413-2fa8666c6076 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.282s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4.part --force-share --output=json" returned: 0 in 0.223s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG nova.virt.images [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] 6d3ad443-5967-40ae-b964-6945a3e49355 was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4.part /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4.part /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4.converted" returned: 0 in 0.582s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.367s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:21:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Instance destroyed successfully.
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lazy-loading 'resources' on Instance uuid 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-96189984',display_name='tempest-VolumesNegativeTest-instance-96189984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-96189984',id=23,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:20:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2e7142d36264f0cbb7a35a88b2fa0e4',ramdisk_id='',reservation_id='r-lqjszwzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-740642040',owner_user_name='tempest-VolumesNegativeTest-740642040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:20:08Z,user_data=None,user_id='fdaba7a0836f416f80f3ef623086e846',uuid=32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Converting VIF {"id": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "address": "fa:16:3e:3c:f9:02", "network": {"id": "5e84095f-4781-40a4-b0e4-8816fa176bdb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a104474ac014eec94f6f21dfd33064b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d70d1-0b", "ovs_interfaceid": "d58d70d1-0b27-4b1d-8afc-b147eefd4226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=d58d70d1-0b27-4b1d-8afc-b147eefd4226,network=Network(5e84095f-4781-40a4-b0e4-8816fa176bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d70d1-0b') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG os_vif [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=d58d70d1-0b27-4b1d-8afc-b147eefd4226,network=Network(5e84095f-4781-40a4-b0e4-8816fa176bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d70d1-0b') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd58d70d1-0b, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b3975f1-0bd0-4f37-a592-39eec2d9b5e4) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:21:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:21:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:52 user nova-compute[75017]: INFO os_vif [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=d58d70d1-0b27-4b1d-8afc-b147eefd4226,network=Network(5e84095f-4781-40a4-b0e4-8816fa176bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d70d1-0b')
Oct 30 09:21:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Deleting instance files /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e_del
Oct 30 09:21:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Deletion of /opt/stack/data/nova/instances/32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e_del complete
Oct 30 09:21:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4.converted --force-share --output=json" returned: 0 in 0.296s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "0bebbd27eccad003710d0331b4eac4e5b1736de4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.644s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "0bebbd27eccad003710d0331b4eac4e5b1736de4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "0bebbd27eccad003710d0331b4eac4e5b1736de4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:52 user nova-compute[75017]: INFO nova.compute.manager [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 30 09:21:52 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:21:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:21:53 user nova-compute[75017]: INFO nova.virt.block_device [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Booting with volume 68e2a69a-e430-4413-866d-fc6e0f3c7d0b at /dev/vda
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4 --force-share --output=json" returned: 0 in 0.242s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4,backing_fmt=raw /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.policy [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2586133b11d0454387d886a6d4515411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61dff8a2a0b9454090a0e2dbe4ff7bca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.utils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4,backing_fmt=raw /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue" returned: 0 in 0.064s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "0bebbd27eccad003710d0331b4eac4e5b1736de4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'migration_context' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7928b08b-de6e-4886-ab78-7f721b70b9de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Object Instance<3833002b-0acf-4093-8f10-097760487c73> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Start _get_guest_xml network_info=[{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "vif_mac": "fa:16:3e:7a:7e:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6d3ad443-5967-40ae-b964-6945a3e49355', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnApGoTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3833002b-0acf-4093-8f10-097760487c73', 'attached_at': '', 'detached_at': '', 'volume_id': '7575e8ce-b5de-4c95-b017-0d73b0113361', 'serial': '7575e8ce-b5de-4c95-b017-0d73b0113361'}, 'disk_bus': 'virtio', 'attachment_id': 'a0bba5af-7c84-411b-aeaa-ee305a1a3454', 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'resources' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadfda96-c3d2-48b4-85b7-e4406988ab44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Object Instance<3833002b-0acf-4093-8f10-097760487c73> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'numa_topology' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Object Instance<3833002b-0acf-4093-8f10-097760487c73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1be46a-33b8-4184-a943-d72403f638a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8317a27d-780e-4287-9585-30034095039c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:21:53 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:21:53 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc99d5a8-9e41-493b-87f0-2ceae6ad767f]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.utils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating existing volume attachment record: 3b2fef88-0eb8-46cb-aeb5-d8b6ef0686a3 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Object Instance<3833002b-0acf-4093-8f10-097760487c73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnApGoTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:21:53 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:21:53 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:21:53 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[30764a12-d21d-427f-a0ff-589ef58a0df1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mnApGoTL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 30 09:21:53 user nova-compute[75017]: node.name = iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361
Oct 30 09:21:53 user nova-compute[75017]: node.tpgt = -1
Oct 30 09:21:53 user nova-compute[75017]: node.startup = automatic
Oct 30 09:21:53 user nova-compute[75017]: node.leading_login = No
Oct 30 09:21:53 user nova-compute[75017]: iface.iscsi_ifacename = default
Oct 30 09:21:53 user nova-compute[75017]: iface.net_ifacename = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.ipaddress = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.prefix_len = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.hwaddress = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.transport_name = tcp
Oct 30 09:21:53 user nova-compute[75017]: iface.initiatorname = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.state = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.vlan_id = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.vlan_priority = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.vlan_state = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.iface_num = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.mtu = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.port = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.bootproto = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.subnet_mask = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.gateway = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.dhcp_alt_client_id_state = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.dhcp_alt_client_id = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.dhcp_dns = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.dhcp_learn_iqn = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.dhcp_req_vendor_id_state = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.dhcp_vendor_id_state = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.dhcp_vendor_id = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.dhcp_slp_da = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.fragmentation = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.gratuitous_arp = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.incoming_forwarding = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.tos_state = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.tos = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.ttl = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.delayed_ack = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.tcp_nagle = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.tcp_wsf_state = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.tcp_wsf = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.tcp_timer_scale = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.tcp_timestamp = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.redirect = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.def_task_mgmt_timeout = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.header_digest = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.data_digest = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.immediate_data = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.initial_r2t = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.data_seq_inorder = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.data_pdu_inorder = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.erl = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.max_receive_data_len = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.first_burst_len = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.max_outstanding_r2t = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.max_burst_len = 0
Oct 30 09:21:53 user nova-compute[75017]: iface.chap_auth = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.bidi_chap = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.strict_login_compliance = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.discovery_auth = <empty>
Oct 30 09:21:53 user nova-compute[75017]: iface.discovery_logout = <empty>
Oct 30 09:21:53 user nova-compute[75017]: node.discovery_address = <empty>
Oct 30 09:21:53 user nova-compute[75017]: node.discovery_port = 0
Oct 30 09:21:53 user nova-compute[75017]: node.discovery_type = static
Oct 30 09:21:53 user nova-compute[75017]: node.session.initial_cmdsn = 0
Oct 30 09:21:53 user nova-compute[75017]: node.session.initial_login_retry_max = 8
Oct 30 09:21:53 user nova-compute[75017]: node.session.xmit_thread_priority = -20
Oct 30 09:21:53 user nova-compute[75017]: node.session.cmds_max = 128
Oct 30 09:21:53 user nova-compute[75017]: node.session.queue_depth = 32
Oct 30 09:21:53 user nova-compute[75017]: node.session.nr_sessions = 1
Oct 30 09:21:53 user nova-compute[75017]: node.session.auth.authmethod = CHAP
Oct 30 09:21:53 user nova-compute[75017]: node.session.auth.username = mnApGoTL
Oct 30 09:21:53 user nova-compute[75017]: node.session.auth.password = ***
Oct 30 09:21:53 user nova-compute[75017]: node.session.auth.username_in = <empty>
Oct 30 09:21:53 user nova-compute[75017]: node.session.auth.password_in = <empty>
Oct 30 09:21:53 user nova-compute[75017]: node.session.auth.chap_algs = MD5
Oct 30 09:21:53 user nova-compute[75017]: node.session.timeo.replacement_timeout = 120
Oct 30 09:21:53 user nova-compute[75017]: node.session.err_timeo.abort_timeout = 15
Oct 30 09:21:53 user nova-compute[75017]: node.session.err_timeo.lu_reset_timeout = 30
Oct 30 09:21:53 user nova-compute[75017]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 30 09:21:53 user nova-compute[75017]: node.session.err_timeo.host_reset_timeout = 60
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.FastAbort = Yes
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.InitialR2T = No
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.ImmediateData = Yes
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.FirstBurstLength = 262144
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.MaxBurstLength = 16776192
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.DefaultTime2Retain = 0
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.DefaultTime2Wait = 2
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.MaxConnections = 1
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 30 09:21:53 user nova-compute[75017]: node.session.iscsi.ERL = 0
Oct 30 09:21:53 user nova-compute[75017]: node.session.scan = manual
Oct 30 09:21:53 user nova-compute[75017]: node.session.reopen_max = 0
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].address = 172.16.0.220
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].port = 3260
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].startup = manual
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].tcp.window_size = 524288
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].tcp.type_of_service = 0
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].timeo.logout_timeout = 15
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].timeo.login_timeout = 15
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].timeo.auth_timeout = 45
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].timeo.noop_out_interval = 5
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].timeo.noop_out_timeout = 5
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].iscsi.HeaderDigest = None
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].iscsi.DataDigest = None
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].iscsi.IFMarker = No
Oct 30 09:21:53 user nova-compute[75017]: node.conn[0].iscsi.OFMarker = No
Oct 30 09:21:53 user nova-compute[75017]: # END RECORD
Oct 30 09:21:53 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49457f9-84bd-4d43-9708-fb58c864adb2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50ffdee-5674-407a-99dd-3fbd764f7db3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnApGoTL {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnApGoTL" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8bb80-a72d-4eee-aafe-39f27a0dbda4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mnApGoTL'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd92185d-402b-42b4-b1a7-606c0f70097e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c132cf-c85f-4d2c-868c-86caed789d19]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:53 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:21:53 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:21:53 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:21:53 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.195s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] HCTL ('36', '0', '0', 0) found on session 19 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82c32c5-4cef-4e21-9f0e-dd7ad00c626b]: (4, ('0 0 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Searching for a device in session 19 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnApGoTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.236s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] <== connect_volume: return (239ms) {'type': 'block', 'scsi_wwn': '23763363434373166', 'path': '/dev/sde'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763363434373166', 'path': '/dev/sde'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.compute.manager [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received event network-vif-unplugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] Acquiring lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.compute.manager [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] No waiting events found dispatching network-vif-unplugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.compute.manager [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received event network-vif-unplugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.compute.manager [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received event network-vif-plugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] Acquiring lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.compute.manager [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] No waiting events found dispatching network-vif-plugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:53 user nova-compute[75017]: WARNING nova.compute.manager [req-392cedc0-cb11-4064-b7ee-73f567a07b9f req-48e51d19-993a-4a4f-a2e6-c9222aed11eb service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received unexpected event network-vif-plugged-d58d70d1-0b27-4b1d-8afc-b147eefd4226 for instance with vm_state active and task_state deleting.
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1160586145',display_name='tempest-ServerStableDeviceRescueTest-server-1160586145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1160586145',id=17,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSUxx57TJQCELhTTTGOfSKVi1iHah3q8zrlE9funAUn/G+GFr2dU6QazUmdaKFAc8RhvFTpouaaDWbh+QWRPsz7Wow/dlb3QsDFKzkjY5ZvvR4TPfqcnmlkyiQWdvU9Uw==',key_name='tempest-keypair-2000133269',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e045f070c72c4a07b6041eba0e6bf7d0',ramdisk_id='',reservation_id='r-t70xmlyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1639847037',owner_user_name='tempest-ServerStableDeviceRescueTest-1639847037-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:19:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8849a4cff6941638c2461918c305c86',uuid=3833002b-0acf-4093-8f10-097760487c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "vif_mac": "fa:16:3e:7a:7e:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Converting VIF {"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "vif_mac": "fa:16:3e:7a:7e:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=8a2b14a4-3ecb-4c54-ac67-7917a612e660,network=Network(935757fd-d9bf-4b7f-9a46-6479e87f7071),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2b14a4-3e') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'pci_devices' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.objects.base [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Object Instance<3833002b-0acf-4093-8f10-097760487c73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:21:53 user nova-compute[75017]:   <uuid>3833002b-0acf-4093-8f10-097760487c73</uuid>
Oct 30 09:21:53 user nova-compute[75017]:   <name>instance-00000011</name>
Oct 30 09:21:53 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:21:53 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:21:53 user nova-compute[75017]:   <metadata>
Oct 30 09:21:53 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:21:53 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:21:53 user nova-compute[75017]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1160586145</nova:name>
Oct 30 09:21:53 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:21:53</nova:creationTime>
Oct 30 09:21:53 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:21:53 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:21:53 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:21:53 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:21:53 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:21:53 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:21:53 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:21:53 user nova-compute[75017]:       <nova:owner>
Oct 30 09:21:53 user nova-compute[75017]:         <nova:user uuid="b8849a4cff6941638c2461918c305c86">tempest-ServerStableDeviceRescueTest-1639847037-project-member</nova:user>
Oct 30 09:21:53 user nova-compute[75017]:         <nova:project uuid="e045f070c72c4a07b6041eba0e6bf7d0">tempest-ServerStableDeviceRescueTest-1639847037</nova:project>
Oct 30 09:21:53 user nova-compute[75017]:       </nova:owner>
Oct 30 09:21:53 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:21:53 user nova-compute[75017]:       <nova:ports>
Oct 30 09:21:53 user nova-compute[75017]:         <nova:port uuid="8a2b14a4-3ecb-4c54-ac67-7917a612e660">
Oct 30 09:21:53 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 09:21:53 user nova-compute[75017]:         </nova:port>
Oct 30 09:21:53 user nova-compute[75017]:       </nova:ports>
Oct 30 09:21:53 user nova-compute[75017]:     </nova:instance>
Oct 30 09:21:53 user nova-compute[75017]:   </metadata>
Oct 30 09:21:53 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:21:53 user nova-compute[75017]:     <system>
Oct 30 09:21:53 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:21:53 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:21:53 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:21:53 user nova-compute[75017]:       <entry name="serial">3833002b-0acf-4093-8f10-097760487c73</entry>
Oct 30 09:21:53 user nova-compute[75017]:       <entry name="uuid">3833002b-0acf-4093-8f10-097760487c73</entry>
Oct 30 09:21:53 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:21:53 user nova-compute[75017]:     </system>
Oct 30 09:21:53 user nova-compute[75017]:   </sysinfo>
Oct 30 09:21:53 user nova-compute[75017]:   <os>
Oct 30 09:21:53 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:21:53 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:21:53 user nova-compute[75017]:   </os>
Oct 30 09:21:53 user nova-compute[75017]:   <features>
Oct 30 09:21:53 user nova-compute[75017]:     <acpi/>
Oct 30 09:21:53 user nova-compute[75017]:     <apic/>
Oct 30 09:21:53 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:21:53 user nova-compute[75017]:   </features>
Oct 30 09:21:53 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:21:53 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:21:53 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:21:53 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:21:53 user nova-compute[75017]:   </clock>
Oct 30 09:21:53 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:21:53 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:21:53 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:21:53 user nova-compute[75017]:   </cpu>
Oct 30 09:21:53 user nova-compute[75017]:   <devices>
Oct 30 09:21:53 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:21:53 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:21:53 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk"/>
Oct 30 09:21:53 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:21:53 user nova-compute[75017]:     </disk>
Oct 30 09:21:53 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:21:53 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:21:53 user nova-compute[75017]:       <source dev="/dev/sde"/>
Oct 30 09:21:53 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:21:53 user nova-compute[75017]:       <serial>7575e8ce-b5de-4c95-b017-0d73b0113361</serial>
Oct 30 09:21:53 user nova-compute[75017]:     </disk>
Oct 30 09:21:53 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:21:53 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:21:53 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue"/>
Oct 30 09:21:53 user nova-compute[75017]:       <target dev="vdc" bus="virtio"/>
Oct 30 09:21:53 user nova-compute[75017]:       <boot order="1"/>
Oct 30 09:21:53 user nova-compute[75017]:     </disk>
Oct 30 09:21:53 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:21:53 user nova-compute[75017]:       <mac address="fa:16:3e:7a:7e:05"/>
Oct 30 09:21:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:21:53 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:21:53 user nova-compute[75017]:       <target dev="tap8a2b14a4-3e"/>
Oct 30 09:21:53 user nova-compute[75017]:     </interface>
Oct 30 09:21:53 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:21:53 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/console.log" append="off"/>
Oct 30 09:21:53 user nova-compute[75017]:     </serial>
Oct 30 09:21:53 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:21:53 user nova-compute[75017]:     <video>
Oct 30 09:21:53 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:21:53 user nova-compute[75017]:     </video>
Oct 30 09:21:53 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:21:53 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:21:53 user nova-compute[75017]:     </rng>
Oct 30 09:21:53 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:21:53 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:21:53 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:21:53 user nova-compute[75017]:     </memballoon>
Oct 30 09:21:53 user nova-compute[75017]:   </devices>
Oct 30 09:21:53 user nova-compute[75017]: </domain>
Oct 30 09:21:53 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:21:53 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Took 0.82 seconds to deallocate network for instance.
Oct 30 09:21:53 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 3833002b-0acf-4093-8f10-097760487c73] Instance destroyed successfully.
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:21:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] No VIF found with MAC fa:16:3e:7a:7e:05, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:21:54 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:21:54 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:21:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully created port: 8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:21:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.637s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:54 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Deleted allocations for instance 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e
Oct 30 09:21:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac7f818c-cc2b-44b5-aa95-dbae539a01e1 tempest-VolumesNegativeTest-740642040 tempest-VolumesNegativeTest-740642040-project-member] Lock "32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.794s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully created port: a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG nova.compute.manager [req-511c95ec-762b-4859-811e-f79558cc0adb req-d94879f5-8b46-4beb-a9fd-b7148c29f82b service nova] [instance: 32646c0c-8bb1-42c9-9ebd-bc1b9c6aff3e] Received event network-vif-deleted-d58d70d1-0b27-4b1d-8afc-b147eefd4226 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG nova.compute.manager [req-511c95ec-762b-4859-811e-f79558cc0adb req-d94879f5-8b46-4beb-a9fd-b7148c29f82b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-511c95ec-762b-4859-811e-f79558cc0adb req-d94879f5-8b46-4beb-a9fd-b7148c29f82b service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-511c95ec-762b-4859-811e-f79558cc0adb req-d94879f5-8b46-4beb-a9fd-b7148c29f82b service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-511c95ec-762b-4859-811e-f79558cc0adb req-d94879f5-8b46-4beb-a9fd-b7148c29f82b service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:55 user nova-compute[75017]: DEBUG nova.compute.manager [req-511c95ec-762b-4859-811e-f79558cc0adb req-d94879f5-8b46-4beb-a9fd-b7148c29f82b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:55 user nova-compute[75017]: WARNING nova.compute.manager [req-511c95ec-762b-4859-811e-f79558cc0adb req-d94879f5-8b46-4beb-a9fd-b7148c29f82b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state active and task_state rescuing.
Oct 30 09:21:56 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully created port: f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:21:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully created port: fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG nova.objects.instance [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'flavor' on Instance uuid 4e5fb05a-f223-414e-ba47-cab136ac7ed1 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:57 user nova-compute[75017]: INFO nova.compute.manager [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Attaching volume dd7a865f-f01e-45ff-acb3-45f25693e4b7 to /dev/vdb
Oct 30 09:21:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG os_brick.utils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cd8ce1-f0f4-440f-9d7a-91265402985f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d4c49f-5991-43d6-9b1e-4f65d84e5d93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1835425-8a92-4aec-a730-461c649fc1e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd60bf24-e7a4-47a3-8040-00a1142723cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully created port: 4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-6f63ac5d-3f27-4d2f-952d-d88fcfed11a9 req-786e3225-84c9-4d04-9d48-5baf2d2408c5 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6f63ac5d-3f27-4d2f-952d-d88fcfed11a9 req-786e3225-84c9-4d04-9d48-5baf2d2408c5 service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6f63ac5d-3f27-4d2f-952d-d88fcfed11a9 req-786e3225-84c9-4d04-9d48-5baf2d2408c5 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6f63ac5d-3f27-4d2f-952d-d88fcfed11a9 req-786e3225-84c9-4d04-9d48-5baf2d2408c5 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-6f63ac5d-3f27-4d2f-952d-d88fcfed11a9 req-786e3225-84c9-4d04-9d48-5baf2d2408c5 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:21:57 user nova-compute[75017]: WARNING nova.compute.manager [req-6f63ac5d-3f27-4d2f-952d-d88fcfed11a9 req-786e3225-84c9-4d04-9d48-5baf2d2408c5 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state active and task_state rescuing.
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:21:57 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:21:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac66adc7-22f3-4cda-a9c3-dcc76fed9ce4]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG os_brick.utils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:21:57 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Updating existing volume attachment record: 206004c0-47b1-4753-8d67-15175c810091 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:21:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5f319fc0-6754-48ac-8e00-ac7652515703 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:21:58 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully updated port: 8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:21:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-38da4b62-c2df-4a75-a37f-82a7803a51cb req-a418017b-9036-4f17-94c0-8fd16d05543a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-changed-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:21:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-38da4b62-c2df-4a75-a37f-82a7803a51cb req-a418017b-9036-4f17-94c0-8fd16d05543a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing instance network info cache due to event network-changed-8902fbc7-3cb8-4930-b993-59b616561923. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:21:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-38da4b62-c2df-4a75-a37f-82a7803a51cb req-a418017b-9036-4f17-94c0-8fd16d05543a service nova] Acquiring lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:21:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-38da4b62-c2df-4a75-a37f-82a7803a51cb req-a418017b-9036-4f17-94c0-8fd16d05543a service nova] Acquired lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:21:58 user nova-compute[75017]: DEBUG nova.network.neutron [req-38da4b62-c2df-4a75-a37f-82a7803a51cb req-a418017b-9036-4f17-94c0-8fd16d05543a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing network info cache for port 8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:21:58 user nova-compute[75017]: DEBUG nova.network.neutron [req-38da4b62-c2df-4a75-a37f-82a7803a51cb req-a418017b-9036-4f17-94c0-8fd16d05543a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:21:59 user nova-compute[75017]: DEBUG nova.network.neutron [req-38da4b62-c2df-4a75-a37f-82a7803a51cb req-a418017b-9036-4f17-94c0-8fd16d05543a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:21:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-38da4b62-c2df-4a75-a37f-82a7803a51cb req-a418017b-9036-4f17-94c0-8fd16d05543a service nova] Releasing lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:21:59 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully updated port: 3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:22:00 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully updated port: c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:22:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-changed-3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing instance network info cache due to event network-changed-3227e083-e191-4e71-8cf9-ee47e00baa27. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:22:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] Acquiring lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] Acquired lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing network info cache for port 3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:22:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully updated port: a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG nova.network.neutron [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] Releasing lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-changed-c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing instance network info cache due to event network-changed-c9d65d25-f069-45d7-b8ec-a6864d8baa6a. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] Acquiring lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] Acquired lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG nova.network.neutron [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing network info cache for port c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG nova.network.neutron [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG nova.network.neutron [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b73bf1e7-9a2b-4bf4-afaf-951804c75c90 req-854e7bdc-1c06-4a68-bc59-5186496e5312 service nova] Releasing lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully updated port: f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-a9d3ad01-19c8-4685-be80-8e47bc8b3f21 req-1d201334-34ad-45cd-ac94-4ce29a142b0f service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-changed-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-a9d3ad01-19c8-4685-be80-8e47bc8b3f21 req-1d201334-34ad-45cd-ac94-4ce29a142b0f service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing instance network info cache due to event network-changed-f5770317-85f6-49fb-be52-2d309dded989. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a9d3ad01-19c8-4685-be80-8e47bc8b3f21 req-1d201334-34ad-45cd-ac94-4ce29a142b0f service nova] Acquiring lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a9d3ad01-19c8-4685-be80-8e47bc8b3f21 req-1d201334-34ad-45cd-ac94-4ce29a142b0f service nova] Acquired lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG nova.network.neutron [req-a9d3ad01-19c8-4685-be80-8e47bc8b3f21 req-1d201334-34ad-45cd-ac94-4ce29a142b0f service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing network info cache for port f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG nova.network.neutron [req-a9d3ad01-19c8-4685-be80-8e47bc8b3f21 req-1d201334-34ad-45cd-ac94-4ce29a142b0f service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG nova.network.neutron [req-a9d3ad01-19c8-4685-be80-8e47bc8b3f21 req-1d201334-34ad-45cd-ac94-4ce29a142b0f service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a9d3ad01-19c8-4685-be80-8e47bc8b3f21 req-1d201334-34ad-45cd-ac94-4ce29a142b0f service nova] Releasing lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-38d0b84f-ffdf-4fe8-9b7b-30bffa004f24 req-403bfc73-861f-4045-a165-748190ad63c1 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-changed-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-38d0b84f-ffdf-4fe8-9b7b-30bffa004f24 req-403bfc73-861f-4045-a165-748190ad63c1 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing instance network info cache due to event network-changed-a7cdb9d1-40de-4831-a41e-71aac9bab889. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-38d0b84f-ffdf-4fe8-9b7b-30bffa004f24 req-403bfc73-861f-4045-a165-748190ad63c1 service nova] Acquiring lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-38d0b84f-ffdf-4fe8-9b7b-30bffa004f24 req-403bfc73-861f-4045-a165-748190ad63c1 service nova] Acquired lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:02 user nova-compute[75017]: DEBUG nova.network.neutron [req-38d0b84f-ffdf-4fe8-9b7b-30bffa004f24 req-403bfc73-861f-4045-a165-748190ad63c1 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing network info cache for port a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:22:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-38d0b84f-ffdf-4fe8-9b7b-30bffa004f24 req-403bfc73-861f-4045-a165-748190ad63c1 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:22:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully updated port: fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:22:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-38d0b84f-ffdf-4fe8-9b7b-30bffa004f24 req-403bfc73-861f-4045-a165-748190ad63c1 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-38d0b84f-ffdf-4fe8-9b7b-30bffa004f24 req-403bfc73-861f-4045-a165-748190ad63c1 service nova] Releasing lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Successfully updated port: 4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:22:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquired lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:22:04 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:22:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-changed-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing instance network info cache due to event network-changed-fd28a095-6324-4d1d-9934-77668c1910f6. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:22:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] Acquiring lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG nova.network.neutron [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Releasing lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance network_info: |[{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] Acquired lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG nova.network.neutron [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing network info cache for port fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG nova.network.neutron [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updated VIF entry in instance network info cache for port fd28a095-6324-4d1d-9934-77668c1910f6. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG nova.network.neutron [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] Releasing lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-changed-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing instance network info cache due to event network-changed-4f505a50-b2ca-4f5f-b06e-9fd1a6646642. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] Acquiring lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] Acquired lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:06 user nova-compute[75017]: DEBUG nova.network.neutron [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing network info cache for port 4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:22:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:07 user nova-compute[75017]: DEBUG nova.network.neutron [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updated VIF entry in instance network info cache for port 4f505a50-b2ca-4f5f-b06e-9fd1a6646642. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:22:07 user nova-compute[75017]: DEBUG nova.network.neutron [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c900072d-17f8-435d-b4d8-3c32edfa00e0 req-df2efe2c-fa91-43e1-a188-c19ad3aff2db service nova] Releasing lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:11 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:22:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue --force-share --output=json" returned: 0 in 0.314s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lazy-loading 'flavor' on Instance uuid 28c7433c-4edd-4d5b-8d9c-68308998a508 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:19 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:22:19 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7248MB free_disk=25.19259262084961GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:19 user nova-compute[75017]: INFO nova.compute.manager [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Attaching volume ce6e7a43-efa8-446e-8f59-1f9116c5664d to /dev/vdb
Oct 30 09:22:19 user nova-compute[75017]: INFO nova.compute.manager [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Terminating instance
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:19 user nova-compute[75017]: INFO nova.virt.block_device [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Booting with volume 4f6c45c7-58ce-4b7e-b457-27bcde41fbef at /dev/vdb
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.utils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 3833002b-0acf-4093-8f10-097760487c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e44fccb6-efe6-461a-91d0-bf1628183258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 2409e52f-cc2e-470a-87d7-c54d67741d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a43f00-b8bc-4c60-b97a-08606d23545b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84705228-03a9-46c7-a53f-8e4e77efc5a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d107162-7a70-4865-8260-c48692a6e912]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.utils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d429d154-fc77-43ca-87ac-6883fc02ca55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e0171-88a7-4e51-9e5b-9bcd127314f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:22:19 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[884f5d4e-e0e2-4299-a59c-cd1d9993e1ec]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.utils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating existing volume attachment record: 8059c540-6502-4696-83d4-34fee3666ffd {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[30945850-782f-4621-b4e3-827e822eb358]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f514de5-064b-4a94-9f34-79f7e67c898f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c474c5-41be-414b-a90e-1e5caf25b590]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:22:19 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:22:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e610a-b401-4e41-99d6-38bcc393f207]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG os_brick.utils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] <== get_connector_properties: return (218ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:22:19 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating existing volume attachment record: 96429f6d-af41-4d07-9948-ece6e53762d8 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.833s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Instance destroyed successfully.
Oct 30 09:22:20 user nova-compute[75017]: DEBUG nova.objects.instance [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lazy-loading 'resources' on Instance uuid 75bb6699-a0c6-4f04-9fca-b0c20b6c0162 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1576787538',display_name='tempest-ServerActionsTestOtherA-server-562515772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1576787538',id=14,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ0D6pPliPvw56NeAbr78L4cM6urRqlbH/HwVTIC+dhKSceCfYhmC9ZsFcU6onZI0QNuc+Jo53dGW/cYd6EH1dN5NBpAtDlqFj9M8umKfz8L6hmG4gKRGk7vkrHTwKdKg==',key_name='tempest-keypair-717482653',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-39dtqb84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:19:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=75bb6699-a0c6-4f04-9fca-b0c20b6c0162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "address": "fa:16:3e:7d:00:b5", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6c6da9-86", "ovs_interfaceid": "8c6c6da9-86d9-442f-905d-7f96f9dc53cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG os_vif [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c6c6da9-86, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=938f8739-43b3-4077-8bed-0cb1ce7a5a4c) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:20 user nova-compute[75017]: INFO os_vif [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:b5,bridge_name='br-int',has_traffic_filtering=True,id=8c6c6da9-86d9-442f-905d-7f96f9dc53cf,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6c6da9-86')
Oct 30 09:22:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Deleting instance files /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162_del
Oct 30 09:22:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Deletion of /opt/stack/data/nova/instances/75bb6699-a0c6-4f04-9fca-b0c20b6c0162_del complete
Oct 30 09:22:20 user nova-compute[75017]: INFO nova.compute.manager [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 30 09:22:20 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:22:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:21 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Took 0.98 seconds to deallocate network for instance.
Oct 30 09:22:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-acb28fed-fe1e-4c49-8121-cceba7328003 req-12d97124-b7e6-4386-8a7d-cd2844761b2d service nova] [instance: 75bb6699-a0c6-4f04-9fca-b0c20b6c0162] Received event network-vif-deleted-8c6c6da9-86d9-442f-905d-7f96f9dc53cf {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 3833002b-0acf-4093-8f10-097760487c73] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:22:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:21 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Deleted allocations for instance 75bb6699-a0c6-4f04-9fca-b0c20b6c0162
Oct 30 09:22:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e52510d5-6889-40ee-a815-3894c02545e5 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "75bb6699-a0c6-4f04-9fca-b0c20b6c0162" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.686s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:22:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:22:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:22:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idYwJeaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:22:26 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:22:26 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:22:26 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a3b01b-afbc-4636-b3d5-fb004440802d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:22:26 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f123fe2-beda-4aee-88af-60fc7412d953]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7] added
Oct 30 09:22:26 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0321bd3-52e9-4229-b654-c5486428b501]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c3709-8225-4916-bd2e-ed10d974f387]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idYwJeaN {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idYwJeaN" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f0bb03-7ed9-423a-982d-2ff95cb6d24f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idYwJeaN'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[519a5cfe-d862-4ec3-b8ac-843713eca0a1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[58198a1c-f588-4b38-935f-6af3f153b8ed]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:26 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:26 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:26 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:26 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[73002fd5-6843-4430-9492-5ed95b3b11bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7, portal: 172.16.0.220,3260]
Oct 30 09:22:26 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7, portal: 172.16.0.220,3260] successful.
Oct 30 09:22:26 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2824273d-12bc-42f6-9b0e-fd50959e093b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9d0237-869a-415e-b4fa-eb66daddc89d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:26 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:26 user nova-compute[75017]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)
Oct 30 09:22:26 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:26 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:26 user nova-compute[75017]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)
Oct 30 09:22:26 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc792f27-3d6f-4cbf-b3ec-4e403576aa2d]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:22:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idYwJeaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:22:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:22:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26432636261373262', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:22:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432636261373262', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:22:27 user nova-compute[75017]: DEBUG nova.objects.instance [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'flavor' on Instance uuid 4e5fb05a-f223-414e-ba47-cab136ac7ed1 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:22:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:22:27 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:22:27 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:22:27 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:22:27 user nova-compute[75017]:   <serial>dd7a865f-f01e-45ff-acb3-45f25693e4b7</serial>
Oct 30 09:22:27 user nova-compute[75017]: </disk>
Oct 30 09:22:27 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:22:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:22:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:22:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No VIF found with MAC fa:16:3e:2a:4a:3a, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:22:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-701effc3-8313-46fc-9615-abbf0d2f0481 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.559s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:29 user nova-compute[75017]: INFO nova.compute.manager [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Detaching volume dd7a865f-f01e-45ff-acb3-45f25693e4b7
Oct 30 09:22:29 user nova-compute[75017]: INFO nova.virt.block_device [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Attempting to driver detach volume dd7a865f-f01e-45ff-acb3-45f25693e4b7 from mountpoint /dev/vdb
Oct 30 09:22:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Attempting to detach device vdb from instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:22:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:22:29 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:22:29 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:22:29 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:22:29 user nova-compute[75017]:   <serial>dd7a865f-f01e-45ff-acb3-45f25693e4b7</serial>
Oct 30 09:22:29 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:22:29 user nova-compute[75017]: </disk>
Oct 30 09:22:29 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:22:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully detached device vdb from instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 from the persistent domain config.
Oct 30 09:22:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:22:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:22:29 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:22:29 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:22:29 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:22:29 user nova-compute[75017]:   <serial>dd7a865f-f01e-45ff-acb3-45f25693e4b7</serial>
Oct 30 09:22:29 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:22:29 user nova-compute[75017]: </disk>
Oct 30 09:22:29 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:22:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:22:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:30 user nova-compute[75017]: DEBUG nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:22:31 user nova-compute[75017]: INFO nova.compute.claims [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Claim successful on node user
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.network.neutron [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:22:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.policy [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98269e46a4d84a02ac9db10534cb7f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a579aacbbc394c4db05d043fa6d820f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:22:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Creating image(s)
Oct 30 09:22:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "/opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "/opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk 1073741824" returned: 0 in 0.069s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG nova.network.neutron [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Successfully created port: 693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Cannot resize image /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Ensure instance console log exists: /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:33 user nova-compute[75017]: DEBUG nova.network.neutron [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Successfully updated port: 693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:22:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "refresh_cache-e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquired lock "refresh_cache-e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:33 user nova-compute[75017]: DEBUG nova.network.neutron [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:22:33 user nova-compute[75017]: DEBUG nova.network.neutron [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:22:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-81a0c3aa-8e17-420b-a587-fe490b9ee425 req-c5a6a087-1a95-492a-b9e1-dc39a86a9949 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received event network-changed-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-81a0c3aa-8e17-420b-a587-fe490b9ee425 req-c5a6a087-1a95-492a-b9e1-dc39a86a9949 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Refreshing instance network info cache due to event network-changed-693ab1d1-4966-4d21-b6e5-acc42f756616. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:22:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-81a0c3aa-8e17-420b-a587-fe490b9ee425 req-c5a6a087-1a95-492a-b9e1-dc39a86a9949 service nova] Acquiring lock "refresh_cache-e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Updating instance_info_cache with network_info: [{"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Releasing lock "refresh_cache-e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Instance network_info: |[{"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-81a0c3aa-8e17-420b-a587-fe490b9ee425 req-c5a6a087-1a95-492a-b9e1-dc39a86a9949 service nova] Acquired lock "refresh_cache-e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.network.neutron [req-81a0c3aa-8e17-420b-a587-fe490b9ee425 req-c5a6a087-1a95-492a-b9e1-dc39a86a9949 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Refreshing network info cache for port 693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Start _get_guest_xml network_info=[{"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:22:34 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:22:34 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:22:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1392445499',display_name='tempest-TestServerVolumeAttachmentScenario-server-1392445499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1392445499',id=26,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJApGoNdNqqxNy3f0BvCik9pU/Krb6whPXzdVcgZGepLQcAEqb8SVsYgQRHJsfIcAndaps3zsWL4Ryukrrdo4SrcTkP6yWrJPxF++IJsQfE7g5vBfjtmRpZAAZ/WR2+mcA==',key_name='tempest-keypair-1287253571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a579aacbbc394c4db05d043fa6d820f9',ramdisk_id='',reservation_id='r-1tx739p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1952307507',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1952307507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98269e46a4d84a02ac9db10534cb7f3f',uuid=e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Converting VIF {"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:a2,bridge_name='br-int',has_traffic_filtering=True,id=693ab1d1-4966-4d21-b6e5-acc42f756616,network=Network(d4ee91b5-e709-455d-ac99-daec15892268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693ab1d1-49') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.objects.instance [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lazy-loading 'pci_devices' on Instance uuid e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:22:34 user nova-compute[75017]:   <uuid>e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3</uuid>
Oct 30 09:22:34 user nova-compute[75017]:   <name>instance-0000001a</name>
Oct 30 09:22:34 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:22:34 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:22:34 user nova-compute[75017]:   <metadata>
Oct 30 09:22:34 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:22:34 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:22:34 user nova-compute[75017]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1392445499</nova:name>
Oct 30 09:22:34 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:22:34</nova:creationTime>
Oct 30 09:22:34 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:22:34 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:22:34 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:22:34 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:22:34 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:22:34 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:22:34 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:22:34 user nova-compute[75017]:       <nova:owner>
Oct 30 09:22:34 user nova-compute[75017]:         <nova:user uuid="98269e46a4d84a02ac9db10534cb7f3f">tempest-TestServerVolumeAttachmentScenario-1952307507-project-member</nova:user>
Oct 30 09:22:34 user nova-compute[75017]:         <nova:project uuid="a579aacbbc394c4db05d043fa6d820f9">tempest-TestServerVolumeAttachmentScenario-1952307507</nova:project>
Oct 30 09:22:34 user nova-compute[75017]:       </nova:owner>
Oct 30 09:22:34 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:22:34 user nova-compute[75017]:       <nova:ports>
Oct 30 09:22:34 user nova-compute[75017]:         <nova:port uuid="693ab1d1-4966-4d21-b6e5-acc42f756616">
Oct 30 09:22:34 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 09:22:34 user nova-compute[75017]:         </nova:port>
Oct 30 09:22:34 user nova-compute[75017]:       </nova:ports>
Oct 30 09:22:34 user nova-compute[75017]:     </nova:instance>
Oct 30 09:22:34 user nova-compute[75017]:   </metadata>
Oct 30 09:22:34 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:22:34 user nova-compute[75017]:     <system>
Oct 30 09:22:34 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:22:34 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:22:34 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:22:34 user nova-compute[75017]:       <entry name="serial">e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3</entry>
Oct 30 09:22:34 user nova-compute[75017]:       <entry name="uuid">e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3</entry>
Oct 30 09:22:34 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:22:34 user nova-compute[75017]:     </system>
Oct 30 09:22:34 user nova-compute[75017]:   </sysinfo>
Oct 30 09:22:34 user nova-compute[75017]:   <os>
Oct 30 09:22:34 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:22:34 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:22:34 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:22:34 user nova-compute[75017]:   </os>
Oct 30 09:22:34 user nova-compute[75017]:   <features>
Oct 30 09:22:34 user nova-compute[75017]:     <acpi/>
Oct 30 09:22:34 user nova-compute[75017]:     <apic/>
Oct 30 09:22:34 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:22:34 user nova-compute[75017]:   </features>
Oct 30 09:22:34 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:22:34 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:22:34 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:22:34 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:22:34 user nova-compute[75017]:   </clock>
Oct 30 09:22:34 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:22:34 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:22:34 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:22:34 user nova-compute[75017]:   </cpu>
Oct 30 09:22:34 user nova-compute[75017]:   <devices>
Oct 30 09:22:34 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:22:34 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:22:34 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk"/>
Oct 30 09:22:34 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:22:34 user nova-compute[75017]:     </disk>
Oct 30 09:22:34 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:22:34 user nova-compute[75017]:       <mac address="fa:16:3e:32:a2:a2"/>
Oct 30 09:22:34 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:22:34 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:22:34 user nova-compute[75017]:       <target dev="tap693ab1d1-49"/>
Oct 30 09:22:34 user nova-compute[75017]:     </interface>
Oct 30 09:22:34 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:22:34 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/console.log" append="off"/>
Oct 30 09:22:34 user nova-compute[75017]:     </serial>
Oct 30 09:22:34 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:22:34 user nova-compute[75017]:     <video>
Oct 30 09:22:34 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:22:34 user nova-compute[75017]:     </video>
Oct 30 09:22:34 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:22:34 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:22:34 user nova-compute[75017]:     </rng>
Oct 30 09:22:34 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:22:34 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:22:34 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:22:34 user nova-compute[75017]:     </memballoon>
Oct 30 09:22:34 user nova-compute[75017]:   </devices>
Oct 30 09:22:34 user nova-compute[75017]: </domain>
Oct 30 09:22:34 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:22:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1392445499',display_name='tempest-TestServerVolumeAttachmentScenario-server-1392445499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1392445499',id=26,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJApGoNdNqqxNy3f0BvCik9pU/Krb6whPXzdVcgZGepLQcAEqb8SVsYgQRHJsfIcAndaps3zsWL4Ryukrrdo4SrcTkP6yWrJPxF++IJsQfE7g5vBfjtmRpZAAZ/WR2+mcA==',key_name='tempest-keypair-1287253571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a579aacbbc394c4db05d043fa6d820f9',ramdisk_id='',reservation_id='r-1tx739p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1952307507',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1952307507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98269e46a4d84a02ac9db10534cb7f3f',uuid=e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Converting VIF {"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:a2,bridge_name='br-int',has_traffic_filtering=True,id=693ab1d1-4966-4d21-b6e5-acc42f756616,network=Network(d4ee91b5-e709-455d-ac99-daec15892268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693ab1d1-49') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG os_vif [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:a2,bridge_name='br-int',has_traffic_filtering=True,id=693ab1d1-4966-4d21-b6e5-acc42f756616,network=Network(d4ee91b5-e709-455d-ac99-daec15892268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693ab1d1-49') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'feba1671-ddde-58f9-905d-0d1daecb5bc9', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap693ab1d1-49, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap693ab1d1-49, col_values=(('qos', UUID('c056cfeb-fb23-4221-be6e-3ee29e5ed295')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap693ab1d1-49, col_values=(('external_ids', {'iface-id': '693ab1d1-4966-4d21-b6e5-acc42f756616', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:a2:a2', 'vm-uuid': 'e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:34 user nova-compute[75017]: INFO os_vif [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:a2,bridge_name='br-int',has_traffic_filtering=True,id=693ab1d1-4966-4d21-b6e5-acc42f756616,network=Network(d4ee91b5-e709-455d-ac99-daec15892268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693ab1d1-49')
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] No VIF found with MAC fa:16:3e:32:a2:a2, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.network.neutron [req-81a0c3aa-8e17-420b-a587-fe490b9ee425 req-c5a6a087-1a95-492a-b9e1-dc39a86a9949 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Updated VIF entry in instance network info cache for port 693ab1d1-4966-4d21-b6e5-acc42f756616. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG nova.network.neutron [req-81a0c3aa-8e17-420b-a587-fe490b9ee425 req-c5a6a087-1a95-492a-b9e1-dc39a86a9949 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Updating instance_info_cache with network_info: [{"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-81a0c3aa-8e17-420b-a587-fe490b9ee425 req-c5a6a087-1a95-492a-b9e1-dc39a86a9949 service nova] Releasing lock "refresh_cache-e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-3c3673f9-6fbe-432d-b902-6b41e089a242 req-bb538aaa-aaba-4f60-b4d1-45fe9a51da58 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received event network-vif-plugged-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3c3673f9-6fbe-432d-b902-6b41e089a242 req-bb538aaa-aaba-4f60-b4d1-45fe9a51da58 service nova] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3c3673f9-6fbe-432d-b902-6b41e089a242 req-bb538aaa-aaba-4f60-b4d1-45fe9a51da58 service nova] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3c3673f9-6fbe-432d-b902-6b41e089a242 req-bb538aaa-aaba-4f60-b4d1-45fe9a51da58 service nova] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-3c3673f9-6fbe-432d-b902-6b41e089a242 req-bb538aaa-aaba-4f60-b4d1-45fe9a51da58 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] No waiting events found dispatching network-vif-plugged-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:36 user nova-compute[75017]: WARNING nova.compute.manager [req-3c3673f9-6fbe-432d-b902-6b41e089a242 req-bb538aaa-aaba-4f60-b4d1-45fe9a51da58 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received unexpected event network-vif-plugged-693ab1d1-4966-4d21-b6e5-acc42f756616 for instance with vm_state building and task_state spawning.
Oct 30 09:22:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-c9910856-07d5-4e97-810d-332e9a226cb0 req-8dc0ecbc-cd55-47bc-97f6-8cf3af66815f service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received event network-vif-plugged-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c9910856-07d5-4e97-810d-332e9a226cb0 req-8dc0ecbc-cd55-47bc-97f6-8cf3af66815f service nova] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c9910856-07d5-4e97-810d-332e9a226cb0 req-8dc0ecbc-cd55-47bc-97f6-8cf3af66815f service nova] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c9910856-07d5-4e97-810d-332e9a226cb0 req-8dc0ecbc-cd55-47bc-97f6-8cf3af66815f service nova] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-c9910856-07d5-4e97-810d-332e9a226cb0 req-8dc0ecbc-cd55-47bc-97f6-8cf3af66815f service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] No waiting events found dispatching network-vif-plugged-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:38 user nova-compute[75017]: WARNING nova.compute.manager [req-c9910856-07d5-4e97-810d-332e9a226cb0 req-8dc0ecbc-cd55-47bc-97f6-8cf3af66815f service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received unexpected event network-vif-plugged-693ab1d1-4966-4d21-b6e5-acc42f756616 for instance with vm_state building and task_state spawning.
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:22:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Instance spawned successfully.
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:22:38 user nova-compute[75017]: INFO nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Took 6.52 seconds to spawn the instance on the hypervisor.
Oct 30 09:22:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:22:38 user nova-compute[75017]: INFO nova.compute.manager [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Took 7.50 seconds to build instance.
Oct 30 09:22:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-49fefd75-5b20-4cf1-ba48-90e38f09bac7 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.610s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:40 user nova-compute[75017]: INFO nova.compute.manager [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Detaching volume 4551dccb-e3d8-497d-b2e2-96a08326280c
Oct 30 09:22:40 user nova-compute[75017]: INFO nova.virt.block_device [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Attempting to driver detach volume 4551dccb-e3d8-497d-b2e2-96a08326280c from mountpoint /dev/vdb
Oct 30 09:22:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Attempting to detach device vdb from instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:22:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:22:40 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:22:40 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:22:40 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:22:40 user nova-compute[75017]:   <serial>4551dccb-e3d8-497d-b2e2-96a08326280c</serial>
Oct 30 09:22:40 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:22:40 user nova-compute[75017]: </disk>
Oct 30 09:22:40 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:22:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Successfully detached device vdb from instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa from the persistent domain config.
Oct 30 09:22:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:22:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:22:40 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:22:40 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:22:40 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:22:40 user nova-compute[75017]:   <serial>4551dccb-e3d8-497d-b2e2-96a08326280c</serial>
Oct 30 09:22:40 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:22:40 user nova-compute[75017]: </disk>
Oct 30 09:22:40 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:22:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:22:43 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:22:43 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:22:43 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aadd9e-1e2f-460a-8997-554676bf05ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:22:43 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0df5735-020b-485d-bbcb-ca8331d139cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d] added
Oct 30 09:22:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b657846c-d373-446c-a064-6023eb0674af]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f087850-3f77-420e-8481-afe51041af8b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOurUpga {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOurUpga" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da187f-ebcc-4c11-bc87-9b219460ebfb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mOurUpga'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c111b340-5475-4433-a62e-68da06ccac6b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd53f6c-b928-4159-854e-6d15f3be6b22]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)
Oct 30 09:22:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)
Oct 30 09:22:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d87d1d2-4435-41f7-a4e3-eb7049fa312a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]
Oct 30 09:22:43 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.
Oct 30 09:22:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec94927-7160-47d8-8b4c-43677295a245]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7e2702-6702-4570-a72f-366a4ddf98f8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:22:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)
Oct 30 09:22:43 user nova-compute[75017]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:22:43 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07086a4-67a3-4ed2-9ec5-3821250ade6f]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:22:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:22:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:22:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26537613665363633', 'path': '/dev/sdd'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:22:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537613665363633', 'path': '/dev/sdd'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:22:44 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lazy-loading 'flavor' on Instance uuid 28c7433c-4edd-4d5b-8d9c-68308998a508 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:22:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:22:44 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:22:44 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:22:44 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:22:44 user nova-compute[75017]:   <serial>ce6e7a43-efa8-446e-8f59-1f9116c5664d</serial>
Oct 30 09:22:44 user nova-compute[75017]: </disk>
Oct 30 09:22:44 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:22:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:22:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:22:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] No VIF found with MAC fa:16:3e:7b:86:de, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:22:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4f1a356-2839-4d0e-8439-31ab3c10bb56 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.850s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:46 user nova-compute[75017]: INFO nova.virt.block_device [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Booting with volume d2296f3e-226d-4bc7-8fb4-4ea592820a54 at /dev/vdc
Oct 30 09:22:46 user nova-compute[75017]: DEBUG os_brick.utils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:22:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6151ac53-c28d-49da-bdb4-276c65ad291c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5363bdfd-6750-464e-b870-42db4498ff77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa81364-cf34-4858-b396-61242bb9e189]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d323f16-369a-49a5-9b8b-73bb208279ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:22:47 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:22:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cd1176-27fb-4dd7-8fd0-9faea21f68e1]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG os_brick.utils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:22:47 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating existing volume attachment record: 39a55dd4-f9a2-4935-87f5-f6cbbe14c1d4 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:22:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Stashing vm_state: active {{(pid=75017) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 30 09:22:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:48 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:22:48 user nova-compute[75017]: INFO nova.compute.claims [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Claim successful on node user
Oct 30 09:22:48 user nova-compute[75017]: INFO nova.compute.resource_tracker [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating resource usage from migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822
Oct 30 09:22:49 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:22:49 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:22:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.505s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:49 user nova-compute[75017]: INFO nova.compute.manager [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Migrating
Oct 30 09:22:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:49 user nova-compute[75017]: INFO nova.compute.rpcapi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 30 09:22:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquired lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:49 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:22:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:22:49 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance_info_cache with network_info: [{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Releasing lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:50 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 is timed out.
Oct 30 09:22:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully detached device vdb from instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 from the live domain config.
Oct 30 09:22:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idYwJeaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:22:50 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f18b3a3-c996-4e96-9e64-0f4253b54b68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:22:50 user nova-compute[75017]: No targets found.
Oct 30 09:22:50 user nova-compute[75017]: iSNS:
Oct 30 09:22:50 user nova-compute[75017]: No targets found.
Oct 30 09:22:50 user nova-compute[75017]: STATIC:
Oct 30 09:22:50 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7
Oct 30 09:22:50 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:22:50 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:22:50 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:22:50 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:22:50 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:22:50 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c
Oct 30 09:22:50 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:22:50 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:22:50 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361
Oct 30 09:22:50 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:22:50 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:22:50 user nova-compute[75017]: FIRMWARE:
Oct 30 09:22:50 user nova-compute[75017]: No targets found.
Oct 30 09:22:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:22:50 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:22:50 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Starting migrate_disk_and_power_off {{(pid=75017) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e0193-956c-4e50-a51e-aa7b38b41a41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce392e5b-26f9-4e68-8656-d1534cca31ef]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:50 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:50 user nova-compute[75017]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)
Oct 30 09:22:50 user nova-compute[75017]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:22:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:50 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:50 user nova-compute[75017]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 (non-flash)
Oct 30 09:22:50 user nova-compute[75017]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:22:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd90670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e9ec1c-101b-495b-bcac-c11ab560851d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc26459-758e-46b3-8670-4183df3c2a67]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[91792fbe-ed7b-4aaa-afc8-0221cc3d69eb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51a761f-e762-4a37-95ac-e68c4fdbf419]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b811c5c0-6f5f-4ecc-866f-03157d65880b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[755136f6-9cfa-4c0f-bdee-fc9968fe38d5]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7, portal: 172.16.0.220,3260]
Oct 30 09:22:50 user nova-compute[75017]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7, portal: 172.16.0.220,3260] successful.
Oct 30 09:22:50 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-8a76ec21-744d-4be7-9d50-6213f1125723 req-33b7872b-bc75-46c9-972a-7762456eb22a service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8a76ec21-744d-4be7-9d50-6213f1125723 req-33b7872b-bc75-46c9-972a-7762456eb22a service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8a76ec21-744d-4be7-9d50-6213f1125723 req-33b7872b-bc75-46c9-972a-7762456eb22a service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8a76ec21-744d-4be7-9d50-6213f1125723 req-33b7872b-bc75-46c9-972a-7762456eb22a service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-8a76ec21-744d-4be7-9d50-6213f1125723 req-33b7872b-bc75-46c9-972a-7762456eb22a service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:50 user nova-compute[75017]: WARNING nova.compute.manager [req-8a76ec21-744d-4be7-9d50-6213f1125723 req-33b7872b-bc75-46c9-972a-7762456eb22a service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state active and task_state resize_migrating.
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7a865f-f01e-45ff-acb3-45f25693e4b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fe1702-f604-4772-94db-adcf85ac9c9f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] <== disconnect_volume: return (407ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance destroyed successfully.
Oct 30 09:22:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-605656703',display_name='tempest-ServerActionsTestOtherB-server-605656703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-605656703',id=19,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsO3D8imqXadqbsvenS1ZFOBMwiMnHotDuidmowiAb2AKB1yeka44kaMsm8Bk0/3S4Tx29wUyIzxAdVbBUzhcdNcjZWvbYuXl0341auprHHVWRadGKrbSxoWPFvfh13Q==',key_name='tempest-keypair-1868016218',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b631fb81c2fc4dc1a7ab30957279de25',ramdisk_id='',reservation_id='r-edgijgvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-794901056',owner_user_name='tempest-ServerActionsTestOtherB-794901056-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:22:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32be8c463bb84c4baa5c8af3900ac613',uuid=28c7433c-4edd-4d5b-8d9c-68308998a508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30976403-network", "vif_mac": "fa:16:3e:7b:86:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converting VIF {"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30976403-network", "vif_mac": "fa:16:3e:7b:86:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_vif [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eb5467b-29, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdf848c9-4062-4fe3-a586-85566249f4e3) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:22:50 user nova-compute[75017]: INFO os_vif [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29')
Oct 30 09:22:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:22:50 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:22:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.039s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ba896f-da56-4327-a67a-812fb7d820b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:22:51 user nova-compute[75017]: No targets found.
Oct 30 09:22:51 user nova-compute[75017]: iSNS:
Oct 30 09:22:51 user nova-compute[75017]: No targets found.
Oct 30 09:22:51 user nova-compute[75017]: STATIC:
Oct 30 09:22:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:22:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:22:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:22:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c
Oct 30 09:22:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:22:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:22:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361
Oct 30 09:22:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:22:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:22:51 user nova-compute[75017]: FIRMWARE:
Oct 30 09:22:51 user nova-compute[75017]: No targets found.
Oct 30 09:22:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:22:51 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:22:51 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0b12eb-213b-490f-9704-5d0fc4a5c901]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa4865f-d17c-468e-941b-bf3c4d69fe22]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:51 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:51 user nova-compute[75017]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:22:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:22:51 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:22:51 user nova-compute[75017]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:22:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d142692d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d'): ({'sdd'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Removing single pathed devices sdd {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c605c15b-2f15-4707-8b91-ba194d35a3f9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a543f4dd-6d0a-4b8b-ad0e-d60cc84a7eb7]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Flushing IO for device /dev/sdd {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3bbb8f-dfcd-474e-a4f9-088746f20038]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccba4e3-b6cb-42db-b87b-c1b4a7969ffd]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.093s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bcd881-331f-4ed4-8392-845ff17b2d04]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0731a7-b60b-429c-9872-86ae0e15b73c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]
Oct 30 09:22:51 user nova-compute[75017]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.
Oct 30 09:22:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44abc3c-483c-4f79-bd1b-b56eb6fc1644]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] <== disconnect_volume: return (475ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG nova.objects.instance [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'flavor' on Instance uuid 4e5fb05a-f223-414e-ba47-cab136ac7ed1 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508_resize/disk /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3896de4d-21e1-436e-9b46-9f9a4aadac4b tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.713s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:52 user nova-compute[75017]: INFO nova.compute.manager [None req-ec657e14-9f02-4a9d-916e-921d2b4a43b8 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Unrescuing
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ec657e14-9f02-4a9d-916e-921d2b4a43b8 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ec657e14-9f02-4a9d-916e-921d2b4a43b8 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquired lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ec657e14-9f02-4a9d-916e-921d2b4a43b8 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:52 user nova-compute[75017]: WARNING nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state active and task_state resize_migrating.
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:52 user nova-compute[75017]: WARNING nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state active and task_state resize_migrating.
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:52 user nova-compute[75017]: WARNING nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state active and task_state resize_migrating.
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:52 user nova-compute[75017]: WARNING nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state active and task_state resize_migrating.
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:52 user nova-compute[75017]: WARNING nova.compute.manager [req-183e8296-a5cf-4e8b-b7d5-2ea85890867e req-7cbb5967-d24d-41c7-95d4-b6f53c8df34d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state active and task_state resize_migrating.
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ec657e14-9f02-4a9d-916e-921d2b4a43b8 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updating instance_info_cache with network_info: [{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "cp -r /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508_resize/disk /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk" returned: 0 in 0.641s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508_resize/disk.info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk.info {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ec657e14-9f02-4a9d-916e-921d2b4a43b8 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Releasing lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ec657e14-9f02-4a9d-916e-921d2b4a43b8 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'flavor' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "cp -r /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508_resize/disk.info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk.info" returned: 0 in 0.061s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:53 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Instance destroyed successfully.
Oct 30 09:22:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-unplugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-unplugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:54 user nova-compute[75017]: WARNING nova.compute.manager [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-unplugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:22:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:54 user nova-compute[75017]: WARNING nova.compute.manager [req-bcb422b0-f24d-4202-8c02-7c155b99899a req-51350b84-6176-48ea-b471-19cb2c64a448 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:22:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:22:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:56 user nova-compute[75017]: WARNING nova.compute.manager [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:22:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:22:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:22:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:22:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:22:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:22:56 user nova-compute[75017]: WARNING nova.compute.manager [req-dddf57b9-f57e-40f5-82e5-c2c666c6f9fa req-4120a0f4-f159-4451-b743-216cc3d5368f service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:22:57 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ec657e14-9f02-4a9d-916e-921d2b4a43b8 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:23:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:01 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa is timed out.
Oct 30 09:23:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Successfully detached device vdb from instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa from the live domain config.
Oct 30 09:23:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BucYlqxf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:23:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7287de1b-67fd-4f52-8527-9bea90f2b164]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:23:01 user nova-compute[75017]: No targets found.
Oct 30 09:23:01 user nova-compute[75017]: iSNS:
Oct 30 09:23:01 user nova-compute[75017]: No targets found.
Oct 30 09:23:01 user nova-compute[75017]: STATIC:
Oct 30 09:23:01 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c
Oct 30 09:23:01 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:23:01 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:23:01 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361
Oct 30 09:23:01 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:23:01 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:23:01 user nova-compute[75017]: FIRMWARE:
Oct 30 09:23:01 user nova-compute[75017]: No targets found.
Oct 30 09:23:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:23:01 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:23:01 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0db641-fac0-49cf-8527-b20a5382e42a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ac42b4-3e7c-459f-81b9-417ba84db141]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:23:01 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c (non-flash)
Oct 30 09:23:01 user nova-compute[75017]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccc71480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3fe491-92c6-4b9b-b578-ece3809e114b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1c3ef4-8be4-4ed6-ae14-cd39fb13aa13]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25a0bf2-93cd-4643-8672-176f72645099]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[81177787-1239-4270-8ce8-c9ac98a8f1f6]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabf4997-03f2-471a-b9fc-addef78b550f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b498047-afb0-4dfd-bdf2-f9242928e786]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c, portal: 172.16.0.220,3260]
Oct 30 09:23:01 user nova-compute[75017]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c, portal: 172.16.0.220,3260] successful.
Oct 30 09:23:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6defd07-33d6-4134-b134-04cb187f1960]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] <== disconnect_volume: return (372ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:23:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'flavor' on Instance uuid 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-14309419-6198-4f62-b061-c1fd7ea99123 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.134s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.021s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:02 user nova-compute[75017]: INFO nova.compute.manager [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Terminating instance
Oct 30 09:23:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-80a92337-4c0c-4c0b-a607-2d391f3a1c45 req-7f02930b-0f1b-41f0-89b6-446737287480 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received event network-vif-unplugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-80a92337-4c0c-4c0b-a607-2d391f3a1c45 req-7f02930b-0f1b-41f0-89b6-446737287480 service nova] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-80a92337-4c0c-4c0b-a607-2d391f3a1c45 req-7f02930b-0f1b-41f0-89b6-446737287480 service nova] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-80a92337-4c0c-4c0b-a607-2d391f3a1c45 req-7f02930b-0f1b-41f0-89b6-446737287480 service nova] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-80a92337-4c0c-4c0b-a607-2d391f3a1c45 req-7f02930b-0f1b-41f0-89b6-446737287480 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] No waiting events found dispatching network-vif-unplugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-80a92337-4c0c-4c0b-a607-2d391f3a1c45 req-7f02930b-0f1b-41f0-89b6-446737287480 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received event network-vif-unplugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:23:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Instance destroyed successfully.
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'resources' on Instance uuid 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2003748459',display_name='tempest-VolumesSnapshotTestJSON-instance-2003748459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2003748459',id=20,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUW1t4+rLM2/ftuVG7Q4geqanKuoSfGKJKhL0xoNkAkbWXZHzuJxFkIy8RDrafQ4o5SODs3PqY1Q7seEiQWa2TGGq+3eVqXlLkVmTtnZ0Twk6XcgrlDXch5fzzOyxbeqw==',key_name='tempest-keypair-710799537',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:19:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2479037737af4b3e925a3d8f99c638ff',ramdisk_id='',reservation_id='r-1bk73cwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-681659515',owner_user_name='tempest-VolumesSnapshotTestJSON-681659515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:19:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5a90dea2584329b7baf5cb83236091',uuid=5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converting VIF {"id": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "address": "fa:16:3e:4d:07:d6", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da3deb4-c4", "ovs_interfaceid": "5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:07:d6,bridge_name='br-int',has_traffic_filtering=True,id=5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5da3deb4-c4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_vif [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:07:d6,bridge_name='br-int',has_traffic_filtering=True,id=5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5da3deb4-c4') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5da3deb4-c4, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=277b6ebc-7e04-4a52-a8b5-d718df620383) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:03 user nova-compute[75017]: INFO os_vif [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:07:d6,bridge_name='br-int',has_traffic_filtering=True,id=5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5da3deb4-c4')
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BucYlqxf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:23:03 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[05359e93-a1e9-45e2-aaf7-a4e1fdc4e761]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:23:03 user nova-compute[75017]: No targets found.
Oct 30 09:23:03 user nova-compute[75017]: iSNS:
Oct 30 09:23:03 user nova-compute[75017]: No targets found.
Oct 30 09:23:03 user nova-compute[75017]: STATIC:
Oct 30 09:23:03 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361
Oct 30 09:23:03 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:23:03 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:23:03 user nova-compute[75017]: FIRMWARE:
Oct 30 09:23:03 user nova-compute[75017]: No targets found.
Oct 30 09:23:03 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:23:03 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:23:03 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4551dccb-e3d8-497d-b2e2-96a08326280c', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[08662e63-3858-4647-a770-9a24aa13e9da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7329a2-e009-47cf-ac66-d2ef5df33780]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:03 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:03 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccc70af0>, {}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Disconnecting from: [] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.098s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] <== disconnect_volume: return (99ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:23:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Deleting instance files /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa_del
Oct 30 09:23:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Deletion of /opt/stack/data/nova/instances/5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa_del complete
Oct 30 09:23:03 user nova-compute[75017]: INFO nova.compute.manager [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 30 09:23:03 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:23:03 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:23:04 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:04 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Took 1.08 seconds to deallocate network for instance.
Oct 30 09:23:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-1c023aa4-d77c-491b-86c3-ce1f8bd05051 req-437aeaeb-8fb6-408a-bc94-dca66477ad73 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received event network-vif-deleted-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:04 user nova-compute[75017]: WARNING nova.volume.cinder [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Attachment e06235e4-9fdb-4bde-a32e-edfe4a258c52 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e06235e4-9fdb-4bde-a32e-edfe4a258c52. (HTTP 404) (Request-ID: req-8a5328e6-b825-4f97-8770-262a3b4a1e8f)
Oct 30 09:23:04 user nova-compute[75017]: INFO nova.compute.manager [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Took 0.04 seconds to detach 1 volumes for instance.
Oct 30 09:23:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-2178d624-ecd2-4e0d-884c-11a869158f94 req-2a752c00-f7ef-424c-b757-c420e3ba1d02 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received event network-vif-plugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2178d624-ecd2-4e0d-884c-11a869158f94 req-2a752c00-f7ef-424c-b757-c420e3ba1d02 service nova] Acquiring lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2178d624-ecd2-4e0d-884c-11a869158f94 req-2a752c00-f7ef-424c-b757-c420e3ba1d02 service nova] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2178d624-ecd2-4e0d-884c-11a869158f94 req-2a752c00-f7ef-424c-b757-c420e3ba1d02 service nova] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-2178d624-ecd2-4e0d-884c-11a869158f94 req-2a752c00-f7ef-424c-b757-c420e3ba1d02 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] No waiting events found dispatching network-vif-plugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:05 user nova-compute[75017]: WARNING nova.compute.manager [req-2178d624-ecd2-4e0d-884c-11a869158f94 req-2a752c00-f7ef-424c-b757-c420e3ba1d02 service nova] [instance: 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa] Received unexpected event network-vif-plugged-5da3deb4-c4c6-4e1f-8b2a-d04a6daab3cd for instance with vm_state deleted and task_state None.
Oct 30 09:23:05 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:23:05 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:23:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.604s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:05 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Deleted allocations for instance 5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa
Oct 30 09:23:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5aa167e5-884a-4bd7-a0f9-9c5e4c086525 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "5a4cbee4-ee8a-43ba-999c-7e4fc9cd56fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.260s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "2409e52f-cc2e-470a-87d7-c54d67741d52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:15 user nova-compute[75017]: INFO nova.compute.manager [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Terminating instance
Oct 30 09:23:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Port 6eb5467b-29cc-4ead-87d9-46828d9a797b binding to destination host user is already ACTIVE {{(pid=75017) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-14e84dc5-6e36-4bbf-a597-65c6f34d1e5b req-a2fae067-b8a9-4599-9660-e883b7a841a0 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received event network-vif-unplugged-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-14e84dc5-6e36-4bbf-a597-65c6f34d1e5b req-a2fae067-b8a9-4599-9660-e883b7a841a0 service nova] Acquiring lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-14e84dc5-6e36-4bbf-a597-65c6f34d1e5b req-a2fae067-b8a9-4599-9660-e883b7a841a0 service nova] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-14e84dc5-6e36-4bbf-a597-65c6f34d1e5b req-a2fae067-b8a9-4599-9660-e883b7a841a0 service nova] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-14e84dc5-6e36-4bbf-a597-65c6f34d1e5b req-a2fae067-b8a9-4599-9660-e883b7a841a0 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] No waiting events found dispatching network-vif-unplugged-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-14e84dc5-6e36-4bbf-a597-65c6f34d1e5b req-a2fae067-b8a9-4599-9660-e883b7a841a0 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received event network-vif-unplugged-cc1a3939-074f-413a-827e-a9c365144018 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Instance destroyed successfully.
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.objects.instance [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lazy-loading 'resources' on Instance uuid 2409e52f-cc2e-470a-87d7-c54d67741d52 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1911679650',display_name='tempest-ServersNegativeTestJSON-server-1911679650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1911679650',id=24,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:21:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98308afa3b794383aca709bceceae3a5',ramdisk_id='',reservation_id='r-8p0jd0sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1551770249',owner_user_name='tempest-ServersNegativeTestJSON-1551770249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:21:33Z,user_data=None,user_id='35a9a593584b4225af22375653d9c33a',uuid=2409e52f-cc2e-470a-87d7-c54d67741d52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converting VIF {"id": "cc1a3939-074f-413a-827e-a9c365144018", "address": "fa:16:3e:cb:cd:59", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1a3939-07", "ovs_interfaceid": "cc1a3939-074f-413a-827e-a9c365144018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:59,bridge_name='br-int',has_traffic_filtering=True,id=cc1a3939-074f-413a-827e-a9c365144018,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1a3939-07') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_vif [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:59,bridge_name='br-int',has_traffic_filtering=True,id=cc1a3939-074f-413a-827e-a9c365144018,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1a3939-07') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc1a3939-07, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93827a6d-08aa-4cf8-8890-a3ab48a29866) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:16 user nova-compute[75017]: INFO os_vif [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:59,bridge_name='br-int',has_traffic_filtering=True,id=cc1a3939-074f-413a-827e-a9c365144018,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1a3939-07')
Oct 30 09:23:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Deleting instance files /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52_del
Oct 30 09:23:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Deletion of /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52_del complete
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquired lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk --force-share --output=json" returned: 1 in 0.260s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk --force-share --output=json' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:23:16 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000018, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/2409e52f-cc2e-470a-87d7-c54d67741d52/disk
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:23:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Creating image(s)
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Ensure instance console log exists: /opt/stack/data/nova/instances/cb56b67f-fe13-48dd-8217-e5a5c84aa9a2/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Start _get_guest_xml network_info=[{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIVenNjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2', 'attached_at': '', 'detached_at': '', 'volume_id': '68e2a69a-e430-4413-866d-fc6e0f3c7d0b', 'serial': '68e2a69a-e430-4413-866d-fc6e0f3c7d0b'}, 'disk_bus': 'virtio', 'attachment_id': '3b2fef88-0eb8-46cb-aeb5-d8b6ef0686a3', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrmVUHqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2', 'attached_at': '', 'detached_at': '', 'volume_id': '4f6c45c7-58ce-4b7e-b457-27bcde41fbef', 'serial': '4f6c45c7-58ce-4b7e-b457-27bcde41fbef'}, 'disk_bus': 'virtio', 'attachment_id': '96429f6d-af41-4d07-9948-ece6e53762d8', 'mount_device': '/dev/vdb', 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKbaxWXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2296f3e-226d-4bc7-8fb4-4ea592820a54', 'serial': 'd2296f3e-226d-4bc7-8fb4-4ea592820a54'}, 'disk_bus': 'virtio', 'attachment_id': '39a55dd4-f9a2-4935-87f5-f6cbbe14c1d4', 'mount_device': '/dev/vdc', 'boot_index': 2, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:23:16 user nova-compute[75017]: INFO nova.compute.manager [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Took 1.33 seconds to destroy the instance on the hypervisor.
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:23:16 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIVenNjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:23:16 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:16 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:16 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd4f3ef-221b-40e1-aa70-2ce2478ba750]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:23:16 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c49b92-91f5-4cb7-a691-cf3c48cd5bd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b] added
Oct 30 09:23:16 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c35269-b105-4bd8-997b-0f7e7ab61a6a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7091c2-f9c5-43d2-99af-756bee1541fd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIVenNjw {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIVenNjw" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7109a216-2709-4352-849b-377df10cf744]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mIVenNjw'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e23f4a1-d550-4169-b26f-9825e7b246e8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecbeb9c-d6be-4c76-ab97-7dbacd650a6c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:16 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:16 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f933dc5d-759d-4f1b-8cee-c5ede208b05f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b, portal: 172.16.0.220,3260]
Oct 30 09:23:16 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b, portal: 172.16.0.220,3260] successful.
Oct 30 09:23:16 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance_info_cache with network_info: [{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4294e514-8bb2-49ea-ba24-005358deffb0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Releasing lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4c2c97-d643-4ea1-a006-ec8bf8bd4125]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:17 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:17 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9888ba-21ce-4436-a38c-e3fc7b0ddbb4]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIVenNjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:17 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Took 0.64 seconds to deallocate network for instance.
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.utils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6cfb27-c3f8-468b-a3b9-082ef588ac9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a15f83-6704-408e-8c89-f473455c8513]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-c2b8dc7d-de6c-4681-9c2b-9e1f4fd4ef1c req-5973a855-f565-4378-94b3-23cf9f929bf6 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received event network-vif-deleted-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[db993cdf-900a-4bcc-8d9d-add3089dc0e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc60067-d633-41a3-904a-5e0fadee6f08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:23:17 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae862b-4045-4b21-9dbb-c6fc9bd5d42d]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG os_brick.utils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] <== get_connector_properties: return (236ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-efe74aff-beb7-407e-98a7-c82f08cc269a req-50bcf085-e069-4fd2-9e17-d3f60b359650 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received event network-vif-plugged-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-efe74aff-beb7-407e-98a7-c82f08cc269a req-50bcf085-e069-4fd2-9e17-d3f60b359650 service nova] Acquiring lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-efe74aff-beb7-407e-98a7-c82f08cc269a req-50bcf085-e069-4fd2-9e17-d3f60b359650 service nova] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-efe74aff-beb7-407e-98a7-c82f08cc269a req-50bcf085-e069-4fd2-9e17-d3f60b359650 service nova] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-efe74aff-beb7-407e-98a7-c82f08cc269a req-50bcf085-e069-4fd2-9e17-d3f60b359650 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] No waiting events found dispatching network-vif-plugged-cc1a3939-074f-413a-827e-a9c365144018 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:17 user nova-compute[75017]: WARNING nova.compute.manager [req-efe74aff-beb7-407e-98a7-c82f08cc269a req-50bcf085-e069-4fd2-9e17-d3f60b359650 service nova] [instance: 2409e52f-cc2e-470a-87d7-c54d67741d52] Received unexpected event network-vif-plugged-cc1a3939-074f-413a-827e-a9c365144018 for instance with vm_state deleted and task_state None.
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.705s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:17 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Deleted allocations for instance 2409e52f-cc2e-470a-87d7-c54d67741d52
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.509s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '23333626135633063', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333626135633063', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-091e2647-c38e-473a-9b9d-b31f2d660378 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "2409e52f-cc2e-470a-87d7-c54d67741d52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.998s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrmVUHqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:23:18 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:18 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:18 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f82c15c-54fe-4580-9f00-b8e1be30feb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:23:18 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaecd05-aaf6-4a8f-8350-e75547a71f68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef] added
Oct 30 09:23:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c7d6d-cab4-418c-b79f-1a06e05f4186]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3468ce6-903e-4daf-bb73-808fde39a0bb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NrmVUHqy {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NrmVUHqy" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4212176a-57d7-4998-97ef-57938c83cc88]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NrmVUHqy'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eef94d-1a10-4206-832b-e3072feac808]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7c0e1e-e8b5-4112-a86b-4d5a43fe9ba2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:18 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:18 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c13932-0ff0-426f-bda2-a0c3bcbe4842]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef, portal: 172.16.0.220,3260]
Oct 30 09:23:18 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef, portal: 172.16.0.220,3260] successful.
Oct 30 09:23:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d50eb2e-360c-4864-8bb3-3ac26c06fc2a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[582b7416-b573-4485-882f-88053a368d13]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:18 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:18 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:18 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:18 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ac7e75-4064-4446-8044-16886ef46e2d]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrmVUHqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:23:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:19 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:23:19 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7490MB free_disk=25.168209075927734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Applying migration context for instance 28c7433c-4edd-4d5b-8d9c-68308998a508 as it has an incoming, in-progress migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822. Migration status is post-migrating {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 30 09:23:19 user nova-compute[75017]: INFO nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating resource usage from migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 3833002b-0acf-4093-8f10-097760487c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e44fccb6-efe6-461a-91d0-bf1628183258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23936653361396231', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936653361396231', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:19 user nova-compute[75017]: INFO nova.compute.manager [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Terminating instance
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKbaxWXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:23:19 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:19 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:19 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[17acfb2b-e681-40f2-aab6-9571d3c0802c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:23:19 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b023555-50db-4a00-9eba-7de122e0e9b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54] added
Oct 30 09:23:19 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8d345a-4277-40f9-8d7d-e5b6da62c1cd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d9477-053a-43d5-b708-794036d98bc5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uKbaxWXP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uKbaxWXP" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20766ec-95d9-444b-83b9-bcab0ea26ba1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uKbaxWXP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee7e298-6ef1-45ea-97ec-74a8bc488950]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3f9e7b-aef6-4aa6-997d-e3816bdf2161]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:19 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:19 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:19 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:19 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:19 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:19 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:23:19 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f3401f-fc4c-4fa1-a750-e85b47d4ba59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54, portal: 172.16.0.220,3260]
Oct 30 09:23:20 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54, portal: 172.16.0.220,3260] successful.
Oct 30 09:23:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-7d065fcd-f4af-4349-8e77-3d1cce36de79 req-543c8acf-5059-49eb-84c7-0690b05da785 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received event network-vif-unplugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7d065fcd-f4af-4349-8e77-3d1cce36de79 req-543c8acf-5059-49eb-84c7-0690b05da785 service nova] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7d065fcd-f4af-4349-8e77-3d1cce36de79 req-543c8acf-5059-49eb-84c7-0690b05da785 service nova] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7d065fcd-f4af-4349-8e77-3d1cce36de79 req-543c8acf-5059-49eb-84c7-0690b05da785 service nova] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-7d065fcd-f4af-4349-8e77-3d1cce36de79 req-543c8acf-5059-49eb-84c7-0690b05da785 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] No waiting events found dispatching network-vif-unplugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-7d065fcd-f4af-4349-8e77-3d1cce36de79 req-543c8acf-5059-49eb-84c7-0690b05da785 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received event network-vif-unplugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.086s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[15425d9d-7d41-414b-8f01-f5ed96a169eb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.765s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e6938c-f407-46d2-baed-f8c70cbc70df]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:20 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:20 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:20 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:23:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:20 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:20 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:20 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:23:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cd33c3-e9bb-41b3-a09f-9a3941243fd5]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKbaxWXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:23:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Instance destroyed successfully.
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'resources' on Instance uuid 4e5fb05a-f223-414e-ba47-cab136ac7ed1 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1793367976',display_name='tempest-AttachVolumeNegativeTest-server-1793367976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1793367976',id=22,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNkwAOdHpb4wYEHHARSgB3vJvO2zAJ6dl+2K+fp6vwDWbZgOstML+OGIJ1viz78SXMHlaDk7YxbjTo/m6xWJWg9lDRw/uDaX8y2ub7MUBmeSziQjcVlZalqCuUPuhtn7g==',key_name='tempest-keypair-934795787',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:20:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-crn8k4xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:20:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=4e5fb05a-f223-414e-ba47-cab136ac7ed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "address": "fa:16:3e:2a:4a:3a", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8eff9f-a7", "ovs_interfaceid": "7f8eff9f-a7d9-45ca-864c-3ee50b304ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4a:3a,bridge_name='br-int',has_traffic_filtering=True,id=7f8eff9f-a7d9-45ca-864c-3ee50b304ea5,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8eff9f-a7') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG os_vif [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4a:3a,bridge_name='br-int',has_traffic_filtering=True,id=7f8eff9f-a7d9-45ca-864c-3ee50b304ea5,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8eff9f-a7') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f8eff9f-a7, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab605e02-ffa3-47e6-bb8c-14a0a7c10f0f) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:23:20 user nova-compute[75017]: INFO nova.compute.claims [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Claim successful on node user
Oct 30 09:23:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:20 user nova-compute[75017]: INFO os_vif [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4a:3a,bridge_name='br-int',has_traffic_filtering=True,id=7f8eff9f-a7d9-45ca-864c-3ee50b304ea5,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8eff9f-a7')
Oct 30 09:23:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Deleting instance files /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1_del
Oct 30 09:23:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Deletion of /opt/stack/data/nova/instances/4e5fb05a-f223-414e-ba47-cab136ac7ed1_del complete
Oct 30 09:23:20 user nova-compute[75017]: INFO nova.compute.manager [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 30 09:23:20 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:23:20 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.neutron [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:23:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '26236323133373763', 'path': '/dev/sdd'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236323133373763', 'path': '/dev/sdd'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.policy [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80fb84f4be3744bfa1cbae9073d698e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daace2dab68b4ca4a8146a4c0615b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:52:11,bridge_name='br-int',has_traffic_filtering=True,id=8902fbc7-3cb8-4930-b993-59b616561923,network=Network(460976ff-5485-4f00-a723-c725a35d1a35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8902fbc7-3c') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:54:2e,bridge_name='br-int',has_traffic_filtering=True,id=3227e083-e191-4e71-8cf9-ee47e00baa27,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3227e083-e1') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:60:3c,bridge_name='br-int',has_traffic_filtering=True,id=c9d65d25-f069-45d7-b8ec-a6864d8baa6a,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d65d25-f0') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:de:11,bridge_name='br-int',has_traffic_filtering=True,id=a7cdb9d1-40de-4831-a41e-71aac9bab889,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7cdb9d1-40') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1c:c9,bridge_name='br-int',has_traffic_filtering=True,id=f5770317-85f6-49fb-be52-2d309dded989,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5770317-85') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:95:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd28a095-6324-4d1d-9934-77668c1910f6,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd28a095-63') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=4f505a50-b2ca-4f5f-b06e-9fd1a6646642,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f505a50-b2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.objects.instance [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lazy-loading 'pci_devices' on Instance uuid cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:23:21 user nova-compute[75017]:   <uuid>cb56b67f-fe13-48dd-8217-e5a5c84aa9a2</uuid>
Oct 30 09:23:21 user nova-compute[75017]:   <name>instance-00000019</name>
Oct 30 09:23:21 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:23:21 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:23:21 user nova-compute[75017]:   <metadata>
Oct 30 09:23:21 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:23:21 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:23:21 user nova-compute[75017]:       <nova:name>tempest-device-tagging-server-1440365771</nova:name>
Oct 30 09:23:21 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:23:16</nova:creationTime>
Oct 30 09:23:21 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:23:21 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:23:21 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:23:21 user nova-compute[75017]:       <nova:owner>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:user uuid="2586133b11d0454387d886a6d4515411">tempest-TaggedBootDevicesTest-345861076-project-member</nova:user>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:project uuid="61dff8a2a0b9454090a0e2dbe4ff7bca">tempest-TaggedBootDevicesTest-345861076</nova:project>
Oct 30 09:23:21 user nova-compute[75017]:       </nova:owner>
Oct 30 09:23:21 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:23:21 user nova-compute[75017]:       <nova:ports>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:port uuid="8902fbc7-3cb8-4930-b993-59b616561923">
Oct 30 09:23:21 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 09:23:21 user nova-compute[75017]:         </nova:port>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:port uuid="3227e083-e191-4e71-8cf9-ee47e00baa27">
Oct 30 09:23:21 user nova-compute[75017]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Oct 30 09:23:21 user nova-compute[75017]:         </nova:port>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:port uuid="c9d65d25-f069-45d7-b8ec-a6864d8baa6a">
Oct 30 09:23:21 user nova-compute[75017]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Oct 30 09:23:21 user nova-compute[75017]:         </nova:port>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:port uuid="a7cdb9d1-40de-4831-a41e-71aac9bab889">
Oct 30 09:23:21 user nova-compute[75017]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
Oct 30 09:23:21 user nova-compute[75017]:         </nova:port>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:port uuid="f5770317-85f6-49fb-be52-2d309dded989">
Oct 30 09:23:21 user nova-compute[75017]:           <nova:ip type="fixed" address="10.1.1.217" ipVersion="4"/>
Oct 30 09:23:21 user nova-compute[75017]:         </nova:port>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:port uuid="fd28a095-6324-4d1d-9934-77668c1910f6">
Oct 30 09:23:21 user nova-compute[75017]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 30 09:23:21 user nova-compute[75017]:         </nova:port>
Oct 30 09:23:21 user nova-compute[75017]:         <nova:port uuid="4f505a50-b2ca-4f5f-b06e-9fd1a6646642">
Oct 30 09:23:21 user nova-compute[75017]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 30 09:23:21 user nova-compute[75017]:         </nova:port>
Oct 30 09:23:21 user nova-compute[75017]:       </nova:ports>
Oct 30 09:23:21 user nova-compute[75017]:     </nova:instance>
Oct 30 09:23:21 user nova-compute[75017]:   </metadata>
Oct 30 09:23:21 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:23:21 user nova-compute[75017]:     <system>
Oct 30 09:23:21 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:23:21 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:23:21 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:23:21 user nova-compute[75017]:       <entry name="serial">cb56b67f-fe13-48dd-8217-e5a5c84aa9a2</entry>
Oct 30 09:23:21 user nova-compute[75017]:       <entry name="uuid">cb56b67f-fe13-48dd-8217-e5a5c84aa9a2</entry>
Oct 30 09:23:21 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:23:21 user nova-compute[75017]:     </system>
Oct 30 09:23:21 user nova-compute[75017]:   </sysinfo>
Oct 30 09:23:21 user nova-compute[75017]:   <os>
Oct 30 09:23:21 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:23:21 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:23:21 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:23:21 user nova-compute[75017]:   </os>
Oct 30 09:23:21 user nova-compute[75017]:   <features>
Oct 30 09:23:21 user nova-compute[75017]:     <acpi/>
Oct 30 09:23:21 user nova-compute[75017]:     <apic/>
Oct 30 09:23:21 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:23:21 user nova-compute[75017]:   </features>
Oct 30 09:23:21 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:23:21 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:23:21 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:23:21 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:23:21 user nova-compute[75017]:   </clock>
Oct 30 09:23:21 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:23:21 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:23:21 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:23:21 user nova-compute[75017]:   </cpu>
Oct 30 09:23:21 user nova-compute[75017]:   <devices>
Oct 30 09:23:21 user nova-compute[75017]:     <disk type="file" device="cdrom">
Oct 30 09:23:21 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 09:23:21 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/cb56b67f-fe13-48dd-8217-e5a5c84aa9a2/disk.config"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="hda" bus="ide"/>
Oct 30 09:23:21 user nova-compute[75017]:     </disk>
Oct 30 09:23:21 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:23:21 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:23:21 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <serial>68e2a69a-e430-4413-866d-fc6e0f3c7d0b</serial>
Oct 30 09:23:21 user nova-compute[75017]:     </disk>
Oct 30 09:23:21 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:23:21 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:23:21 user nova-compute[75017]:       <source dev="/dev/sdc"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <serial>4f6c45c7-58ce-4b7e-b457-27bcde41fbef</serial>
Oct 30 09:23:21 user nova-compute[75017]:     </disk>
Oct 30 09:23:21 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:23:21 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:23:21 user nova-compute[75017]:       <source dev="/dev/sdd"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="vdc" bus="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <serial>d2296f3e-226d-4bc7-8fb4-4ea592820a54</serial>
Oct 30 09:23:21 user nova-compute[75017]:     </disk>
Oct 30 09:23:21 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:23:21 user nova-compute[75017]:       <mac address="fa:16:3e:f6:52:11"/>
Oct 30 09:23:21 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="tap8902fbc7-3c"/>
Oct 30 09:23:21 user nova-compute[75017]:     </interface>
Oct 30 09:23:21 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:23:21 user nova-compute[75017]:       <mac address="fa:16:3e:a8:54:2e"/>
Oct 30 09:23:21 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="tap3227e083-e1"/>
Oct 30 09:23:21 user nova-compute[75017]:     </interface>
Oct 30 09:23:21 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:23:21 user nova-compute[75017]:       <mac address="fa:16:3e:ff:60:3c"/>
Oct 30 09:23:21 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="tapc9d65d25-f0"/>
Oct 30 09:23:21 user nova-compute[75017]:     </interface>
Oct 30 09:23:21 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:23:21 user nova-compute[75017]:       <mac address="fa:16:3e:25:de:11"/>
Oct 30 09:23:21 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="tapa7cdb9d1-40"/>
Oct 30 09:23:21 user nova-compute[75017]:     </interface>
Oct 30 09:23:21 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:23:21 user nova-compute[75017]:       <mac address="fa:16:3e:66:1c:c9"/>
Oct 30 09:23:21 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="tapf5770317-85"/>
Oct 30 09:23:21 user nova-compute[75017]:     </interface>
Oct 30 09:23:21 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:23:21 user nova-compute[75017]:       <mac address="fa:16:3e:50:95:7f"/>
Oct 30 09:23:21 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="tapfd28a095-63"/>
Oct 30 09:23:21 user nova-compute[75017]:     </interface>
Oct 30 09:23:21 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:23:21 user nova-compute[75017]:       <mac address="fa:16:3e:37:d7:60"/>
Oct 30 09:23:21 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:23:21 user nova-compute[75017]:       <target dev="tap4f505a50-b2"/>
Oct 30 09:23:21 user nova-compute[75017]:     </interface>
Oct 30 09:23:21 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:23:21 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/cb56b67f-fe13-48dd-8217-e5a5c84aa9a2/console.log" append="off"/>
Oct 30 09:23:21 user nova-compute[75017]:     </serial>
Oct 30 09:23:21 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:23:21 user nova-compute[75017]:     <video>
Oct 30 09:23:21 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:21 user nova-compute[75017]:     </video>
Oct 30 09:23:21 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:23:21 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:23:21 user nova-compute[75017]:     </rng>
Oct 30 09:23:21 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:23:21 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:23:21 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:23:21 user nova-compute[75017]:     </memballoon>
Oct 30 09:23:21 user nova-compute[75017]:   </devices>
Oct 30 09:23:21 user nova-compute[75017]: </domain>
Oct 30 09:23:21 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:52:11,bridge_name='br-int',has_traffic_filtering=True,id=8902fbc7-3cb8-4930-b993-59b616561923,network=Network(460976ff-5485-4f00-a723-c725a35d1a35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8902fbc7-3c') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:52:11,bridge_name='br-int',has_traffic_filtering=True,id=8902fbc7-3cb8-4930-b993-59b616561923,network=Network(460976ff-5485-4f00-a723-c725a35d1a35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8902fbc7-3c') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03ab502d-f9c2-5ba8-b265-a2a529c4e30e', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8902fbc7-3c, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8902fbc7-3c, col_values=(('qos', UUID('51bdd33f-1459-4fd0-8465-4f1cb11fa684')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8902fbc7-3c, col_values=(('external_ids', {'iface-id': '8902fbc7-3cb8-4930-b993-59b616561923', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:52:11', 'vm-uuid': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:23:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Creating image(s)
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "/opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "/opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "/opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: INFO os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:52:11,bridge_name='br-int',has_traffic_filtering=True,id=8902fbc7-3cb8-4930-b993-59b616561923,network=Network(460976ff-5485-4f00-a723-c725a35d1a35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8902fbc7-3c')
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:54:2e,bridge_name='br-int',has_traffic_filtering=True,id=3227e083-e191-4e71-8cf9-ee47e00baa27,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3227e083-e1') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:54:2e,bridge_name='br-int',has_traffic_filtering=True,id=3227e083-e191-4e71-8cf9-ee47e00baa27,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3227e083-e1') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fbfa519-2c68-5d7f-bc5a-aebd59a8b765', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3227e083-e1, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3227e083-e1, col_values=(('qos', UUID('6adb8d61-e0b3-47aa-b738-d63071289cca')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3227e083-e1, col_values=(('external_ids', {'iface-id': '3227e083-e191-4e71-8cf9-ee47e00baa27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:54:2e', 'vm-uuid': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: INFO os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:54:2e,bridge_name='br-int',has_traffic_filtering=True,id=3227e083-e191-4e71-8cf9-ee47e00baa27,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3227e083-e1')
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:60:3c,bridge_name='br-int',has_traffic_filtering=True,id=c9d65d25-f069-45d7-b8ec-a6864d8baa6a,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d65d25-f0') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:60:3c,bridge_name='br-int',has_traffic_filtering=True,id=c9d65d25-f069-45d7-b8ec-a6864d8baa6a,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d65d25-f0') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '437e2895-24df-5c1b-96a9-1e27817d8439', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Took 0.88 seconds to deallocate network for instance.
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9d65d25-f0, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9d65d25-f0, col_values=(('qos', UUID('d9709e0a-83ae-4d88-8e12-99cb0006c789')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9d65d25-f0, col_values=(('external_ids', {'iface-id': 'c9d65d25-f069-45d7-b8ec-a6864d8baa6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:60:3c', 'vm-uuid': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: INFO os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:60:3c,bridge_name='br-int',has_traffic_filtering=True,id=c9d65d25-f069-45d7-b8ec-a6864d8baa6a,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d65d25-f0')
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:de:11,bridge_name='br-int',has_traffic_filtering=True,id=a7cdb9d1-40de-4831-a41e-71aac9bab889,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7cdb9d1-40') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:de:11,bridge_name='br-int',has_traffic_filtering=True,id=a7cdb9d1-40de-4831-a41e-71aac9bab889,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7cdb9d1-40') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f76f633c-7456-5513-be6d-f3874fc386f8', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7cdb9d1-40, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7cdb9d1-40, col_values=(('qos', UUID('705559da-ad94-4e4c-9434-fc9aed89747b')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7cdb9d1-40, col_values=(('external_ids', {'iface-id': 'a7cdb9d1-40de-4831-a41e-71aac9bab889', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:de:11', 'vm-uuid': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: INFO os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:de:11,bridge_name='br-int',has_traffic_filtering=True,id=a7cdb9d1-40de-4831-a41e-71aac9bab889,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7cdb9d1-40')
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1c:c9,bridge_name='br-int',has_traffic_filtering=True,id=f5770317-85f6-49fb-be52-2d309dded989,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5770317-85') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1c:c9,bridge_name='br-int',has_traffic_filtering=True,id=f5770317-85f6-49fb-be52-2d309dded989,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5770317-85') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a813af7f-7130-518d-a009-98f9619527c8', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5770317-85, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5770317-85, col_values=(('qos', UUID('ec89a732-0d92-4dce-9e3a-c09eb828b8d8')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5770317-85, col_values=(('external_ids', {'iface-id': 'f5770317-85f6-49fb-be52-2d309dded989', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:1c:c9', 'vm-uuid': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: INFO os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1c:c9,bridge_name='br-int',has_traffic_filtering=True,id=f5770317-85f6-49fb-be52-2d309dded989,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5770317-85')
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:95:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd28a095-6324-4d1d-9934-77668c1910f6,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd28a095-63') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:95:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd28a095-6324-4d1d-9934-77668c1910f6,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd28a095-63') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25453b7c-bfc4-5afc-b2b2-b1eac27e1b46', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk 1073741824" returned: 0 in 0.088s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.neutron [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Successfully created port: 9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd28a095-63, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd28a095-63, col_values=(('qos', UUID('55c13e2f-8c8d-4052-92b2-d15c0e987251')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd28a095-63, col_values=(('external_ids', {'iface-id': 'fd28a095-6324-4d1d-9934-77668c1910f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:95:7f', 'vm-uuid': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: INFO os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:95:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd28a095-6324-4d1d-9934-77668c1910f6,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd28a095-63')
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=4f505a50-b2ca-4f5f-b06e-9fd1a6646642,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f505a50-b2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=4f505a50-b2ca-4f5f-b06e-9fd1a6646642,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f505a50-b2') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5575ea2a-f12e-5614-a691-15238a9f2366', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f505a50-b2, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f505a50-b2, col_values=(('qos', UUID('c4bded0d-cd67-4297-b396-7f18aedbf86b')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f505a50-b2, col_values=(('external_ids', {'iface-id': '4f505a50-b2ca-4f5f-b06e-9fd1a6646642', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:d7:60', 'vm-uuid': 'cb56b67f-fe13-48dd-8217-e5a5c84aa9a2'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.213s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-c4b654df-1697-44e1-aae7-2c410053665a req-c428c4e5-cab6-449e-9c5c-df174b794703 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received event network-vif-plugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c4b654df-1697-44e1-aae7-2c410053665a req-c428c4e5-cab6-449e-9c5c-df174b794703 service nova] Acquiring lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c4b654df-1697-44e1-aae7-2c410053665a req-c428c4e5-cab6-449e-9c5c-df174b794703 service nova] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c4b654df-1697-44e1-aae7-2c410053665a req-c428c4e5-cab6-449e-9c5c-df174b794703 service nova] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-c4b654df-1697-44e1-aae7-2c410053665a req-c428c4e5-cab6-449e-9c5c-df174b794703 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] No waiting events found dispatching network-vif-plugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:22 user nova-compute[75017]: WARNING nova.compute.manager [req-c4b654df-1697-44e1-aae7-2c410053665a req-c428c4e5-cab6-449e-9c5c-df174b794703 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received unexpected event network-vif-plugged-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 for instance with vm_state deleted and task_state None.
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-c4b654df-1697-44e1-aae7-2c410053665a req-c428c4e5-cab6-449e-9c5c-df174b794703 service nova] [instance: 4e5fb05a-f223-414e-ba47-cab136ac7ed1] Received event network-vif-deleted-7f8eff9f-a7d9-45ca-864c-3ee50b304ea5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:22 user nova-compute[75017]: INFO os_vif [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=4f505a50-b2ca-4f5f-b06e-9fd1a6646642,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f505a50-b2')
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.656s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Cannot resize image /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Ensure instance console log exists: /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] No BDM found with device name hda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] No VIF found with MAC fa:16:3e:f6:52:11, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] No VIF found with MAC fa:16:3e:66:1c:c9, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:23:22 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Using config drive
Oct 30 09:23:22 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Deleted allocations for instance 4e5fb05a-f223-414e-ba47-cab136ac7ed1
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5ae5a6ac-7078-4c33-b889-1d648fa0c3e7 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "4e5fb05a-f223-414e-ba47-cab136ac7ed1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.751s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:22 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Creating config drive at /opt/stack/data/nova/instances/cb56b67f-fe13-48dd-8217-e5a5c84aa9a2/disk.config
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cb56b67f-fe13-48dd-8217-e5a5c84aa9a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqr8rqgq5 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cb56b67f-fe13-48dd-8217-e5a5c84aa9a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqr8rqgq5" returned: 0 in 0.072s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Successfully updated port: 9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "refresh_cache-f574374d-8672-4215-b099-2b663288f6ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquired lock "refresh_cache-f574374d-8672-4215-b099-2b663288f6ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-e5550d45-740d-4581-87eb-366e348fb124 req-f4470a92-de40-4d66-be22-88d05173768e service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received event network-changed-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-e5550d45-740d-4581-87eb-366e348fb124 req-f4470a92-de40-4d66-be22-88d05173768e service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Refreshing instance network info cache due to event network-changed-9e28ff70-628f-4e32-b24b-19676f74db8e. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e5550d45-740d-4581-87eb-366e348fb124 req-f4470a92-de40-4d66-be22-88d05173768e service nova] Acquiring lock "refresh_cache-f574374d-8672-4215-b099-2b663288f6ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance_info_cache with network_info: [{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:23:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.network.neutron [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.network.neutron [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Updating instance_info_cache with network_info: [{"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Releasing lock "refresh_cache-f574374d-8672-4215-b099-2b663288f6ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Instance network_info: |[{"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e5550d45-740d-4581-87eb-366e348fb124 req-f4470a92-de40-4d66-be22-88d05173768e service nova] Acquired lock "refresh_cache-f574374d-8672-4215-b099-2b663288f6ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-e5550d45-740d-4581-87eb-366e348fb124 req-f4470a92-de40-4d66-be22-88d05173768e service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Refreshing network info cache for port 9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Start _get_guest_xml network_info=[{"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:23:23 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:23:23 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-67720669',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-67720669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6772066',id=27,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqhY4Xp9vgtiWid5h98BER16QjvU1cSgpT4iYzN/dmcPpKDZE0foUQLJVWvVX6Wgtf9QV/s9d2z3nUfuqbLzk0CP0wG6Fte6p692Qed4/voE6vRSUTrHFvKNKMHeX876g==',key_name='tempest-keypair-36117091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daace2dab68b4ca4a8146a4c0615b7ac',ramdisk_id='',reservation_id='r-heh90eec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1064777854',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fb84f4be3744bfa1cbae9073d698e5',uuid=f574374d-8672-4215-b099-2b663288f6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Converting VIF {"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e5:dc,bridge_name='br-int',has_traffic_filtering=True,id=9e28ff70-628f-4e32-b24b-19676f74db8e,network=Network(c1900997-3004-4697-9b5b-bb6ba5f9924f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e28ff70-62') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lazy-loading 'pci_devices' on Instance uuid f574374d-8672-4215-b099-2b663288f6ab {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:23:23 user nova-compute[75017]:   <uuid>f574374d-8672-4215-b099-2b663288f6ab</uuid>
Oct 30 09:23:23 user nova-compute[75017]:   <name>instance-0000001b</name>
Oct 30 09:23:23 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:23:23 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:23:23 user nova-compute[75017]:   <metadata>
Oct 30 09:23:23 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:23:23 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:23:23 user nova-compute[75017]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-67720669</nova:name>
Oct 30 09:23:23 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:23:23</nova:creationTime>
Oct 30 09:23:23 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:23:23 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:23:23 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:23:23 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:23:23 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:23:23 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:23:23 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:23:23 user nova-compute[75017]:       <nova:owner>
Oct 30 09:23:23 user nova-compute[75017]:         <nova:user uuid="80fb84f4be3744bfa1cbae9073d698e5">tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member</nova:user>
Oct 30 09:23:23 user nova-compute[75017]:         <nova:project uuid="daace2dab68b4ca4a8146a4c0615b7ac">tempest-TestServerVolumeAttachScenarioOldVersion-1064777854</nova:project>
Oct 30 09:23:23 user nova-compute[75017]:       </nova:owner>
Oct 30 09:23:23 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:23:23 user nova-compute[75017]:       <nova:ports>
Oct 30 09:23:23 user nova-compute[75017]:         <nova:port uuid="9e28ff70-628f-4e32-b24b-19676f74db8e">
Oct 30 09:23:23 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 09:23:23 user nova-compute[75017]:         </nova:port>
Oct 30 09:23:23 user nova-compute[75017]:       </nova:ports>
Oct 30 09:23:23 user nova-compute[75017]:     </nova:instance>
Oct 30 09:23:23 user nova-compute[75017]:   </metadata>
Oct 30 09:23:23 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:23:23 user nova-compute[75017]:     <system>
Oct 30 09:23:23 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:23:23 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:23:23 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:23:23 user nova-compute[75017]:       <entry name="serial">f574374d-8672-4215-b099-2b663288f6ab</entry>
Oct 30 09:23:23 user nova-compute[75017]:       <entry name="uuid">f574374d-8672-4215-b099-2b663288f6ab</entry>
Oct 30 09:23:23 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:23:23 user nova-compute[75017]:     </system>
Oct 30 09:23:23 user nova-compute[75017]:   </sysinfo>
Oct 30 09:23:23 user nova-compute[75017]:   <os>
Oct 30 09:23:23 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:23:23 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:23:23 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:23:23 user nova-compute[75017]:   </os>
Oct 30 09:23:23 user nova-compute[75017]:   <features>
Oct 30 09:23:23 user nova-compute[75017]:     <acpi/>
Oct 30 09:23:23 user nova-compute[75017]:     <apic/>
Oct 30 09:23:23 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:23:23 user nova-compute[75017]:   </features>
Oct 30 09:23:23 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:23:23 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:23:23 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:23:23 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:23:23 user nova-compute[75017]:   </clock>
Oct 30 09:23:23 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:23:23 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:23:23 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:23:23 user nova-compute[75017]:   </cpu>
Oct 30 09:23:23 user nova-compute[75017]:   <devices>
Oct 30 09:23:23 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:23:23 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:23:23 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk"/>
Oct 30 09:23:23 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:23:23 user nova-compute[75017]:     </disk>
Oct 30 09:23:23 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:23:23 user nova-compute[75017]:       <mac address="fa:16:3e:4d:e5:dc"/>
Oct 30 09:23:23 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:23 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:23:23 user nova-compute[75017]:       <target dev="tap9e28ff70-62"/>
Oct 30 09:23:23 user nova-compute[75017]:     </interface>
Oct 30 09:23:23 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:23:23 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/console.log" append="off"/>
Oct 30 09:23:23 user nova-compute[75017]:     </serial>
Oct 30 09:23:23 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:23:23 user nova-compute[75017]:     <video>
Oct 30 09:23:23 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:23 user nova-compute[75017]:     </video>
Oct 30 09:23:23 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:23:23 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:23:23 user nova-compute[75017]:     </rng>
Oct 30 09:23:23 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:23:23 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:23:23 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:23:23 user nova-compute[75017]:     </memballoon>
Oct 30 09:23:23 user nova-compute[75017]:   </devices>
Oct 30 09:23:23 user nova-compute[75017]: </domain>
Oct 30 09:23:23 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-67720669',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-67720669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6772066',id=27,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqhY4Xp9vgtiWid5h98BER16QjvU1cSgpT4iYzN/dmcPpKDZE0foUQLJVWvVX6Wgtf9QV/s9d2z3nUfuqbLzk0CP0wG6Fte6p692Qed4/voE6vRSUTrHFvKNKMHeX876g==',key_name='tempest-keypair-36117091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daace2dab68b4ca4a8146a4c0615b7ac',ramdisk_id='',reservation_id='r-heh90eec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1064777854',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fb84f4be3744bfa1cbae9073d698e5',uuid=f574374d-8672-4215-b099-2b663288f6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Converting VIF {"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e5:dc,bridge_name='br-int',has_traffic_filtering=True,id=9e28ff70-628f-4e32-b24b-19676f74db8e,network=Network(c1900997-3004-4697-9b5b-bb6ba5f9924f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e28ff70-62') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG os_vif [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e5:dc,bridge_name='br-int',has_traffic_filtering=True,id=9e28ff70-628f-4e32-b24b-19676f74db8e,network=Network(c1900997-3004-4697-9b5b-bb6ba5f9924f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e28ff70-62') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eef7aceb-93b5-5912-a315-4633d1317f2a', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e28ff70-62, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e28ff70-62, col_values=(('qos', UUID('053b4b00-4efb-4916-8fc9-34c92a042fd2')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e28ff70-62, col_values=(('external_ids', {'iface-id': '9e28ff70-628f-4e32-b24b-19676f74db8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:e5:dc', 'vm-uuid': 'f574374d-8672-4215-b099-2b663288f6ab'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:23 user nova-compute[75017]: INFO os_vif [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e5:dc,bridge_name='br-int',has_traffic_filtering=True,id=9e28ff70-628f-4e32-b24b-19676f74db8e,network=Network(c1900997-3004-4697-9b5b-bb6ba5f9924f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e28ff70-62')
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] No VIF found with MAC fa:16:3e:4d:e5:dc, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-e5550d45-740d-4581-87eb-366e348fb124 req-f4470a92-de40-4d66-be22-88d05173768e service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Updated VIF entry in instance network info cache for port 9e28ff70-628f-4e32-b24b-19676f74db8e. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-e5550d45-740d-4581-87eb-366e348fb124 req-f4470a92-de40-4d66-be22-88d05173768e service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Updating instance_info_cache with network_info: [{"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e5550d45-740d-4581-87eb-366e348fb124 req-f4470a92-de40-4d66-be22-88d05173768e service nova] Releasing lock "refresh_cache-f574374d-8672-4215-b099-2b663288f6ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:23:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-51d358d4-02b8-408e-84d6-8e559c49475c req-fe3831e1-3c2c-4808-96ac-215d088f465b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-51d358d4-02b8-408e-84d6-8e559c49475c req-fe3831e1-3c2c-4808-96ac-215d088f465b service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-51d358d4-02b8-408e-84d6-8e559c49475c req-fe3831e1-3c2c-4808-96ac-215d088f465b service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-51d358d4-02b8-408e-84d6-8e559c49475c req-fe3831e1-3c2c-4808-96ac-215d088f465b service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-51d358d4-02b8-408e-84d6-8e559c49475c req-fe3831e1-3c2c-4808-96ac-215d088f465b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:24 user nova-compute[75017]: WARNING nova.compute.manager [req-51d358d4-02b8-408e-84d6-8e559c49475c req-fe3831e1-3c2c-4808-96ac-215d088f465b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-8902fbc7-3cb8-4930-b993-59b616561923 for instance with vm_state building and task_state spawning.
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-53b56ae1-e1e7-46f2-b923-a74bd5d6635d req-19ceac9d-2e79-46d8-bbe9-06104c3b8f81 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-53b56ae1-e1e7-46f2-b923-a74bd5d6635d req-19ceac9d-2e79-46d8-bbe9-06104c3b8f81 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-53b56ae1-e1e7-46f2-b923-a74bd5d6635d req-19ceac9d-2e79-46d8-bbe9-06104c3b8f81 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-53b56ae1-e1e7-46f2-b923-a74bd5d6635d req-19ceac9d-2e79-46d8-bbe9-06104c3b8f81 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-53b56ae1-e1e7-46f2-b923-a74bd5d6635d req-19ceac9d-2e79-46d8-bbe9-06104c3b8f81 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:26 user nova-compute[75017]: WARNING nova.compute.manager [req-53b56ae1-e1e7-46f2-b923-a74bd5d6635d req-19ceac9d-2e79-46d8-bbe9-06104c3b8f81 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a for instance with vm_state building and task_state spawning.
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:26 user nova-compute[75017]: WARNING nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-8902fbc7-3cb8-4930-b993-59b616561923 for instance with vm_state building and task_state spawning.
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:26 user nova-compute[75017]: WARNING nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-3227e083-e191-4e71-8cf9-ee47e00baa27 for instance with vm_state building and task_state spawning.
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:26 user nova-compute[75017]: WARNING nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-3227e083-e191-4e71-8cf9-ee47e00baa27 for instance with vm_state building and task_state spawning.
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received event network-vif-plugged-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] No waiting events found dispatching network-vif-plugged-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:26 user nova-compute[75017]: WARNING nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received unexpected event network-vif-plugged-9e28ff70-628f-4e32-b24b-19676f74db8e for instance with vm_state building and task_state spawning.
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received event network-vif-plugged-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] No waiting events found dispatching network-vif-plugged-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:26 user nova-compute[75017]: WARNING nova.compute.manager [req-cdfdf31d-6924-4058-badc-432a8af12a97 req-fff7905c-0214-4eb2-be20-ecfb0ed4e77b service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received unexpected event network-vif-plugged-9e28ff70-628f-4e32-b24b-19676f74db8e for instance with vm_state building and task_state spawning.
Oct 30 09:23:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-127a5628-f822-436d-8879-31bd97f6ef9c req-082146c2-b7fc-4043-b579-7a4d7c213233 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-127a5628-f822-436d-8879-31bd97f6ef9c req-082146c2-b7fc-4043-b579-7a4d7c213233 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-127a5628-f822-436d-8879-31bd97f6ef9c req-082146c2-b7fc-4043-b579-7a4d7c213233 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-127a5628-f822-436d-8879-31bd97f6ef9c req-082146c2-b7fc-4043-b579-7a4d7c213233 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-127a5628-f822-436d-8879-31bd97f6ef9c req-082146c2-b7fc-4043-b579-7a4d7c213233 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:28 user nova-compute[75017]: WARNING nova.compute.manager [req-127a5628-f822-436d-8879-31bd97f6ef9c req-082146c2-b7fc-4043-b579-7a4d7c213233 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 for instance with vm_state building and task_state spawning.
Oct 30 09:23:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:28 user nova-compute[75017]: WARNING nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a for instance with vm_state building and task_state spawning.
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:28 user nova-compute[75017]: WARNING nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 for instance with vm_state building and task_state spawning.
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:28 user nova-compute[75017]: WARNING nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 for instance with vm_state building and task_state spawning.
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:28 user nova-compute[75017]: WARNING nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-fd28a095-6324-4d1d-9934-77668c1910f6 for instance with vm_state building and task_state spawning.
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:28 user nova-compute[75017]: WARNING nova.compute.manager [req-a24bcbe6-4987-419b-8e02-4a6950b77874 req-67e84231-e76d-4bf2-bfe6-03b6a161eb30 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-fd28a095-6324-4d1d-9934-77668c1910f6 for instance with vm_state building and task_state spawning.
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:29 user nova-compute[75017]: WARNING nova.compute.manager [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-f5770317-85f6-49fb-be52-2d309dded989 for instance with vm_state building and task_state spawning.
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:29 user nova-compute[75017]: WARNING nova.compute.manager [req-b998ef06-ddb5-4b16-882e-0cceed7de8b3 req-51be4522-df5f-4f29-8c3a-c45a58205071 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-f5770317-85f6-49fb-be52-2d309dded989 for instance with vm_state building and task_state spawning.
Oct 30 09:23:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:23:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f574374d-8672-4215-b099-2b663288f6ab] Instance spawned successfully.
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:29 user nova-compute[75017]: INFO nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Took 8.41 seconds to spawn the instance on the hypervisor.
Oct 30 09:23:29 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:29 user nova-compute[75017]: INFO nova.compute.manager [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Took 9.40 seconds to build instance.
Oct 30 09:23:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a4d67887-5727-4c2c-95d0-a589ecfec11c tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.521s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-4cd1b69a-d94c-4d70-b7ee-c7009c829341 req-3d414810-11ed-4677-9a6f-b4626a55528f service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4cd1b69a-d94c-4d70-b7ee-c7009c829341 req-3d414810-11ed-4677-9a6f-b4626a55528f service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4cd1b69a-d94c-4d70-b7ee-c7009c829341 req-3d414810-11ed-4677-9a6f-b4626a55528f service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4cd1b69a-d94c-4d70-b7ee-c7009c829341 req-3d414810-11ed-4677-9a6f-b4626a55528f service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-4cd1b69a-d94c-4d70-b7ee-c7009c829341 req-3d414810-11ed-4677-9a6f-b4626a55528f service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:30 user nova-compute[75017]: WARNING nova.compute.manager [req-4cd1b69a-d94c-4d70-b7ee-c7009c829341 req-3d414810-11ed-4677-9a6f-b4626a55528f service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 for instance with vm_state building and task_state spawning.
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:23:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance spawned successfully.
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:23:30 user nova-compute[75017]: INFO nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Took 14.09 seconds to spawn the instance on the hypervisor.
Oct 30 09:23:30 user nova-compute[75017]: DEBUG nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:23:30 user nova-compute[75017]: INFO nova.compute.manager [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Took 100.46 seconds to build instance.
Oct 30 09:23:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-05e3d0b5-5856-4493-b027-1345665cca65 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 100.809s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:39 user nova-compute[75017]: INFO nova.compute.manager [None req-2fc98d31-f14f-4bfb-8ff1-626e94973417 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Unrescuing
Oct 30 09:23:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2fc98d31-f14f-4bfb-8ff1-626e94973417 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:23:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2fc98d31-f14f-4bfb-8ff1-626e94973417 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquired lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:23:39 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2fc98d31-f14f-4bfb-8ff1-626e94973417 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2fc98d31-f14f-4bfb-8ff1-626e94973417 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2fc98d31-f14f-4bfb-8ff1-626e94973417 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Releasing lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG nova.objects.instance [None req-2fc98d31-f14f-4bfb-8ff1-626e94973417 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'flavor' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Starting finish_migration {{(pid=75017) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance directory exists: not creating {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 09:23:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Creating image(s)
Oct 30 09:23:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.207s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk. size=21474836480 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:23:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-c5d6546e-a0e0-4b0d-8360-0e6c25531e49 req-80fb730c-898f-4a0a-baf9-fd5317505d6c service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-unplugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c5d6546e-a0e0-4b0d-8360-0e6c25531e49 req-80fb730c-898f-4a0a-baf9-fd5317505d6c service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c5d6546e-a0e0-4b0d-8360-0e6c25531e49 req-80fb730c-898f-4a0a-baf9-fd5317505d6c service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c5d6546e-a0e0-4b0d-8360-0e6c25531e49 req-80fb730c-898f-4a0a-baf9-fd5317505d6c service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-c5d6546e-a0e0-4b0d-8360-0e6c25531e49 req-80fb730c-898f-4a0a-baf9-fd5317505d6c service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-unplugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:41 user nova-compute[75017]: WARNING nova.compute.manager [req-c5d6546e-a0e0-4b0d-8360-0e6c25531e49 req-80fb730c-898f-4a0a-baf9-fd5317505d6c service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-unplugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk 21474836480 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk 21474836480" returned: 0 in 0.067s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Ensure instance console log exists: /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Start _get_guest_xml network_info=[{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30976403-network", "vif_mac": "fa:16:3e:7b:86:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '28c7433c-4edd-4d5b-8d9c-68308998a508', 'attached_at': '2023-10-30T09:23:40.000000', 'detached_at': '', 'volume_id': 'ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'serial': 'ce6e7a43-efa8-446e-8f59-1f9116c5664d'}, 'disk_bus': 'virtio', 'attachment_id': '21d349ce-6feb-4346-b018-98c11d300fdc', 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:23:41 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:23:41 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:23:41 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:41 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:23:41 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 3833002b-0acf-4093-8f10-097760487c73] Instance destroyed successfully.
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f56a276-1395-4f4d-ac10-7013b6e8ed1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:23:41 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ad6de0-63a6-4d3d-8e04-4024caea751f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d] added
Oct 30 09:23:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e4bc067-2867-4de2-926a-32baac3f837d req-89dfc439-4ee6-46f4-a0f6-6940c3a4eb97 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-changed-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e4bc067-2867-4de2-926a-32baac3f837d req-89dfc439-4ee6-46f4-a0f6-6940c3a4eb97 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Refreshing instance network info cache due to event network-changed-8a2b14a4-3ecb-4c54-ac67-7917a612e660. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e4bc067-2867-4de2-926a-32baac3f837d req-89dfc439-4ee6-46f4-a0f6-6940c3a4eb97 service nova] Acquiring lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e4bc067-2867-4de2-926a-32baac3f837d req-89dfc439-4ee6-46f4-a0f6-6940c3a4eb97 service nova] Acquired lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-7e4bc067-2867-4de2-926a-32baac3f837d req-89dfc439-4ee6-46f4-a0f6-6940c3a4eb97 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Refreshing network info cache for port 8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4c041d-62f2-4910-9c7d-a3916c495e6d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fccb8e3-2efb-422b-8081-c38bacd3b1b2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOurUpga {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOurUpga" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[867fc1e5-267a-4245-b398-2196b861ada5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mOurUpga'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb37de32-9fcb-42d9-aa52-07a4f428d219]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6da96e-ec63-4ab3-b259-5c094f2f6fa2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:23:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:23:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d452681b-3b41-4e52-9940-d6e9bd635ef9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]
Oct 30 09:23:41 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.
Oct 30 09:23:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ff779d-4429-4d48-b546-d75b255ec8dc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f83ea1-e772-4339-8733-da231faf71ad]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:23:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:23:41 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:23:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cf437d-da88-4b70-937e-1d3761d2aa93]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-7e4bc067-2867-4de2-926a-32baac3f837d req-89dfc439-4ee6-46f4-a0f6-6940c3a4eb97 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updated VIF entry in instance network info cache for port 8a2b14a4-3ecb-4c54-ac67-7917a612e660. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:23:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-7e4bc067-2867-4de2-926a-32baac3f837d req-89dfc439-4ee6-46f4-a0f6-6940c3a4eb97 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e4bc067-2867-4de2-926a-32baac3f837d req-89dfc439-4ee6-46f4-a0f6-6940c3a4eb97 service nova] Releasing lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '26537613665363633', 'path': '/dev/sdf'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537613665363633', 'path': '/dev/sdf'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-605656703',display_name='tempest-ServerActionsTestOtherB-server-605656703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-605656703',id=19,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsO3D8imqXadqbsvenS1ZFOBMwiMnHotDuidmowiAb2AKB1yeka44kaMsm8Bk0/3S4Tx29wUyIzxAdVbBUzhcdNcjZWvbYuXl0341auprHHVWRadGKrbSxoWPFvfh13Q==',key_name='tempest-keypair-1868016218',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b631fb81c2fc4dc1a7ab30957279de25',ramdisk_id='',reservation_id='r-edgijgvg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-794901056',owner_user_name='tempest-ServerActionsTestOtherB-794901056-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32be8c463bb84c4baa5c8af3900ac613',uuid=28c7433c-4edd-4d5b-8d9c-68308998a508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30976403-network", "vif_mac": "fa:16:3e:7b:86:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converting VIF {"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30976403-network", "vif_mac": "fa:16:3e:7b:86:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:23:42 user nova-compute[75017]:   <uuid>28c7433c-4edd-4d5b-8d9c-68308998a508</uuid>
Oct 30 09:23:42 user nova-compute[75017]:   <name>instance-00000013</name>
Oct 30 09:23:42 user nova-compute[75017]:   <memory>2097152</memory>
Oct 30 09:23:42 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:23:42 user nova-compute[75017]:   <metadata>
Oct 30 09:23:42 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:23:42 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:23:42 user nova-compute[75017]:       <nova:name>tempest-ServerActionsTestOtherB-server-605656703</nova:name>
Oct 30 09:23:42 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:23:41</nova:creationTime>
Oct 30 09:23:42 user nova-compute[75017]:       <nova:flavor name="m1.small">
Oct 30 09:23:42 user nova-compute[75017]:         <nova:memory>2048</nova:memory>
Oct 30 09:23:42 user nova-compute[75017]:         <nova:disk>20</nova:disk>
Oct 30 09:23:42 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:23:42 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:23:42 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:23:42 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:23:42 user nova-compute[75017]:       <nova:owner>
Oct 30 09:23:42 user nova-compute[75017]:         <nova:user uuid="32be8c463bb84c4baa5c8af3900ac613">tempest-ServerActionsTestOtherB-794901056-project-member</nova:user>
Oct 30 09:23:42 user nova-compute[75017]:         <nova:project uuid="b631fb81c2fc4dc1a7ab30957279de25">tempest-ServerActionsTestOtherB-794901056</nova:project>
Oct 30 09:23:42 user nova-compute[75017]:       </nova:owner>
Oct 30 09:23:42 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:23:42 user nova-compute[75017]:       <nova:ports>
Oct 30 09:23:42 user nova-compute[75017]:         <nova:port uuid="6eb5467b-29cc-4ead-87d9-46828d9a797b">
Oct 30 09:23:42 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 09:23:42 user nova-compute[75017]:         </nova:port>
Oct 30 09:23:42 user nova-compute[75017]:       </nova:ports>
Oct 30 09:23:42 user nova-compute[75017]:     </nova:instance>
Oct 30 09:23:42 user nova-compute[75017]:   </metadata>
Oct 30 09:23:42 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:23:42 user nova-compute[75017]:     <system>
Oct 30 09:23:42 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:23:42 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:23:42 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:23:42 user nova-compute[75017]:       <entry name="serial">28c7433c-4edd-4d5b-8d9c-68308998a508</entry>
Oct 30 09:23:42 user nova-compute[75017]:       <entry name="uuid">28c7433c-4edd-4d5b-8d9c-68308998a508</entry>
Oct 30 09:23:42 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:23:42 user nova-compute[75017]:     </system>
Oct 30 09:23:42 user nova-compute[75017]:   </sysinfo>
Oct 30 09:23:42 user nova-compute[75017]:   <os>
Oct 30 09:23:42 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:23:42 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:23:42 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:23:42 user nova-compute[75017]:   </os>
Oct 30 09:23:42 user nova-compute[75017]:   <features>
Oct 30 09:23:42 user nova-compute[75017]:     <acpi/>
Oct 30 09:23:42 user nova-compute[75017]:     <apic/>
Oct 30 09:23:42 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:23:42 user nova-compute[75017]:   </features>
Oct 30 09:23:42 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:23:42 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:23:42 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:23:42 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:23:42 user nova-compute[75017]:   </clock>
Oct 30 09:23:42 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:23:42 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:23:42 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:23:42 user nova-compute[75017]:   </cpu>
Oct 30 09:23:42 user nova-compute[75017]:   <devices>
Oct 30 09:23:42 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:23:42 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:23:42 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk"/>
Oct 30 09:23:42 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:23:42 user nova-compute[75017]:     </disk>
Oct 30 09:23:42 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:23:42 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:23:42 user nova-compute[75017]:       <source dev="/dev/sdf"/>
Oct 30 09:23:42 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:23:42 user nova-compute[75017]:       <serial>ce6e7a43-efa8-446e-8f59-1f9116c5664d</serial>
Oct 30 09:23:42 user nova-compute[75017]:     </disk>
Oct 30 09:23:42 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:23:42 user nova-compute[75017]:       <mac address="fa:16:3e:7b:86:de"/>
Oct 30 09:23:42 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:42 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:23:42 user nova-compute[75017]:       <target dev="tap6eb5467b-29"/>
Oct 30 09:23:42 user nova-compute[75017]:     </interface>
Oct 30 09:23:42 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:23:42 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/console.log" append="off"/>
Oct 30 09:23:42 user nova-compute[75017]:     </serial>
Oct 30 09:23:42 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:23:42 user nova-compute[75017]:     <video>
Oct 30 09:23:42 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:23:42 user nova-compute[75017]:     </video>
Oct 30 09:23:42 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:23:42 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:23:42 user nova-compute[75017]:     </rng>
Oct 30 09:23:42 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:23:42 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:23:42 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:23:42 user nova-compute[75017]:     </memballoon>
Oct 30 09:23:42 user nova-compute[75017]:   </devices>
Oct 30 09:23:42 user nova-compute[75017]: </domain>
Oct 30 09:23:42 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-605656703',display_name='tempest-ServerActionsTestOtherB-server-605656703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-605656703',id=19,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsO3D8imqXadqbsvenS1ZFOBMwiMnHotDuidmowiAb2AKB1yeka44kaMsm8Bk0/3S4Tx29wUyIzxAdVbBUzhcdNcjZWvbYuXl0341auprHHVWRadGKrbSxoWPFvfh13Q==',key_name='tempest-keypair-1868016218',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b631fb81c2fc4dc1a7ab30957279de25',ramdisk_id='',reservation_id='r-edgijgvg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-794901056',owner_user_name='tempest-ServerActionsTestOtherB-794901056-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32be8c463bb84c4baa5c8af3900ac613',uuid=28c7433c-4edd-4d5b-8d9c-68308998a508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30976403-network", "vif_mac": "fa:16:3e:7b:86:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converting VIF {"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30976403-network", "vif_mac": "fa:16:3e:7b:86:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG os_vif [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ed303ac-fc9f-58b9-b08c-23d5f1157205', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eb5467b-29, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6eb5467b-29, col_values=(('qos', UUID('1d858bde-4111-4114-9248-0495e5d479e1')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6eb5467b-29, col_values=(('external_ids', {'iface-id': '6eb5467b-29cc-4ead-87d9-46828d9a797b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:86:de', 'vm-uuid': '28c7433c-4edd-4d5b-8d9c-68308998a508'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:23:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:42 user nova-compute[75017]: INFO os_vif [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29')
Oct 30 09:23:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] No VIF found with MAC fa:16:3e:7b:86:de, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2684e9e-43aa-46bd-a4f0-3354e6adbab1 req-58044265-39ff-4504-9f01-cce174d7492e service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2684e9e-43aa-46bd-a4f0-3354e6adbab1 req-58044265-39ff-4504-9f01-cce174d7492e service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2684e9e-43aa-46bd-a4f0-3354e6adbab1 req-58044265-39ff-4504-9f01-cce174d7492e service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2684e9e-43aa-46bd-a4f0-3354e6adbab1 req-58044265-39ff-4504-9f01-cce174d7492e service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2684e9e-43aa-46bd-a4f0-3354e6adbab1 req-58044265-39ff-4504-9f01-cce174d7492e service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:43 user nova-compute[75017]: WARNING nova.compute.manager [req-e2684e9e-43aa-46bd-a4f0-3354e6adbab1 req-58044265-39ff-4504-9f01-cce174d7492e service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:23:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-4896fc39-951e-44ce-9ab3-20edd7997ef8 req-090008ca-e8b7-4d96-a640-1eeddce668bd service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-changed-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-4896fc39-951e-44ce-9ab3-20edd7997ef8 req-090008ca-e8b7-4d96-a640-1eeddce668bd service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Refreshing instance network info cache due to event network-changed-8a2b14a4-3ecb-4c54-ac67-7917a612e660. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4896fc39-951e-44ce-9ab3-20edd7997ef8 req-090008ca-e8b7-4d96-a640-1eeddce668bd service nova] Acquiring lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4896fc39-951e-44ce-9ab3-20edd7997ef8 req-090008ca-e8b7-4d96-a640-1eeddce668bd service nova] Acquired lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG nova.network.neutron [req-4896fc39-951e-44ce-9ab3-20edd7997ef8 req-090008ca-e8b7-4d96-a640-1eeddce668bd service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Refreshing network info cache for port 8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:44 user nova-compute[75017]: DEBUG nova.network.neutron [req-4896fc39-951e-44ce-9ab3-20edd7997ef8 req-090008ca-e8b7-4d96-a640-1eeddce668bd service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updated VIF entry in instance network info cache for port 8a2b14a4-3ecb-4c54-ac67-7917a612e660. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:23:44 user nova-compute[75017]: DEBUG nova.network.neutron [req-4896fc39-951e-44ce-9ab3-20edd7997ef8 req-090008ca-e8b7-4d96-a640-1eeddce668bd service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [{"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:23:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4896fc39-951e-44ce-9ab3-20edd7997ef8 req-090008ca-e8b7-4d96-a640-1eeddce668bd service nova] Releasing lock "refresh_cache-3833002b-0acf-4093-8f10-097760487c73" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:23:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:45 user nova-compute[75017]: WARNING nova.compute.manager [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:23:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:45 user nova-compute[75017]: WARNING nova.compute.manager [req-e35e0605-bf87-4a0e-beb7-3b18606c2b47 req-9ec2531b-f06e-4e8b-b25e-fe80d15c2e9b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:23:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:45 user nova-compute[75017]: WARNING nova.compute.manager [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state active and task_state resize_finish.
Oct 30 09:23:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:23:45 user nova-compute[75017]: WARNING nova.compute.manager [req-56ab8e9a-6a7f-4455-a2c2-54268a70f36b req-cf6e2012-7878-47ca-987e-764a9a6d2511 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state active and task_state resize_finish.
Oct 30 09:23:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2fc98d31-f14f-4bfb-8ff1-626e94973417 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:23:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:23:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance running successfully.
Oct 30 09:23:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Failed to set time: agent not configured {{(pid=75017) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 30 09:23:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ac75ea2a-b7d0-4a90-b230-8710b591a52c tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] finish_migration finished successfully. {{(pid=75017) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 30 09:23:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:23:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:13 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:13 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:13 user nova-compute[75017]: INFO nova.compute.manager [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Detaching volume 7575e8ce-b5de-4c95-b017-0d73b0113361
Oct 30 09:24:13 user nova-compute[75017]: INFO nova.virt.block_device [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Attempting to driver detach volume 7575e8ce-b5de-4c95-b017-0d73b0113361 from mountpoint /dev/vdb
Oct 30 09:24:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Attempting to detach device vdb from instance 3833002b-0acf-4093-8f10-097760487c73 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:24:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:24:13 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:24:13 user nova-compute[75017]:   <source dev="/dev/sde"/>
Oct 30 09:24:13 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:24:13 user nova-compute[75017]:   <serial>7575e8ce-b5de-4c95-b017-0d73b0113361</serial>
Oct 30 09:24:13 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:24:13 user nova-compute[75017]: </disk>
Oct 30 09:24:13 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:24:13 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Successfully detached device vdb from instance 3833002b-0acf-4093-8f10-097760487c73 from the persistent domain config.
Oct 30 09:24:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3833002b-0acf-4093-8f10-097760487c73 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:24:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:24:13 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:24:13 user nova-compute[75017]:   <source dev="/dev/sde"/>
Oct 30 09:24:13 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:24:13 user nova-compute[75017]:   <serial>7575e8ce-b5de-4c95-b017-0d73b0113361</serial>
Oct 30 09:24:13 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:24:13 user nova-compute[75017]: </disk>
Oct 30 09:24:13 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:24:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:24:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:24:15 user nova-compute[75017]: INFO nova.compute.claims [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Claim successful on node user
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.158s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.policy [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'edd9037b1ceb4b899f6d446b565a6ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4606fc32534a589e07baa3a4e76d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:24:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Creating image(s)
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "/opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "/opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "/opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk 1073741824" returned: 0 in 0.067s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Successfully created port: 7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Cannot resize image /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Ensure instance console log exists: /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Successfully updated port: 7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "refresh_cache-bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquired lock "refresh_cache-bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-49333fbe-e099-4883-a8fd-d98052ac8246 req-6829076a-beef-43a8-b31f-096177f99701 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-changed-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-49333fbe-e099-4883-a8fd-d98052ac8246 req-6829076a-beef-43a8-b31f-096177f99701 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Refreshing instance network info cache due to event network-changed-7c7cadfe-ab46-4565-8b85-a5fcd123707c. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-49333fbe-e099-4883-a8fd-d98052ac8246 req-6829076a-beef-43a8-b31f-096177f99701 service nova] Acquiring lock "refresh_cache-bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Updating instance_info_cache with network_info: [{"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Releasing lock "refresh_cache-bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Instance network_info: |[{"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-49333fbe-e099-4883-a8fd-d98052ac8246 req-6829076a-beef-43a8-b31f-096177f99701 service nova] Acquired lock "refresh_cache-bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-49333fbe-e099-4883-a8fd-d98052ac8246 req-6829076a-beef-43a8-b31f-096177f99701 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Refreshing network info cache for port 7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Start _get_guest_xml network_info=[{"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:24:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:24:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1925502918',display_name='tempest-AttachVolumeNegativeTest-server-1925502918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1925502918',id=28,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvFNW+FZCLIn9+XJyPTCsn1OYwfOdO0Rs+T0FcTUhCcW9miflNYxtwUrx8d69RVKnLRWIZkj3muQ2JctxSPHsc6phs5FoTjew4UMFhSLX9vGL85pDbZpMUh7tD4W3LLRQ==',key_name='tempest-keypair-1675761624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-ogwu60ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f9:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c7cadfe-ab46-4565-8b85-a5fcd123707c,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7cadfe-ab') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'pci_devices' on Instance uuid bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:24:17 user nova-compute[75017]:   <uuid>bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d</uuid>
Oct 30 09:24:17 user nova-compute[75017]:   <name>instance-0000001c</name>
Oct 30 09:24:17 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:24:17 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:24:17 user nova-compute[75017]:   <metadata>
Oct 30 09:24:17 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:24:17 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:24:17 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1925502918</nova:name>
Oct 30 09:24:17 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:24:17</nova:creationTime>
Oct 30 09:24:17 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:24:17 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:24:17 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:24:17 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:24:17 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:24:17 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:24:17 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:24:17 user nova-compute[75017]:       <nova:owner>
Oct 30 09:24:17 user nova-compute[75017]:         <nova:user uuid="edd9037b1ceb4b899f6d446b565a6ff9">tempest-AttachVolumeNegativeTest-63898760-project-member</nova:user>
Oct 30 09:24:17 user nova-compute[75017]:         <nova:project uuid="2a4606fc32534a589e07baa3a4e76d48">tempest-AttachVolumeNegativeTest-63898760</nova:project>
Oct 30 09:24:17 user nova-compute[75017]:       </nova:owner>
Oct 30 09:24:17 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:24:17 user nova-compute[75017]:       <nova:ports>
Oct 30 09:24:17 user nova-compute[75017]:         <nova:port uuid="7c7cadfe-ab46-4565-8b85-a5fcd123707c">
Oct 30 09:24:17 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 09:24:17 user nova-compute[75017]:         </nova:port>
Oct 30 09:24:17 user nova-compute[75017]:       </nova:ports>
Oct 30 09:24:17 user nova-compute[75017]:     </nova:instance>
Oct 30 09:24:17 user nova-compute[75017]:   </metadata>
Oct 30 09:24:17 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:24:17 user nova-compute[75017]:     <system>
Oct 30 09:24:17 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:24:17 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:24:17 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:24:17 user nova-compute[75017]:       <entry name="serial">bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d</entry>
Oct 30 09:24:17 user nova-compute[75017]:       <entry name="uuid">bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d</entry>
Oct 30 09:24:17 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:24:17 user nova-compute[75017]:     </system>
Oct 30 09:24:17 user nova-compute[75017]:   </sysinfo>
Oct 30 09:24:17 user nova-compute[75017]:   <os>
Oct 30 09:24:17 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:24:17 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:24:17 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:24:17 user nova-compute[75017]:   </os>
Oct 30 09:24:17 user nova-compute[75017]:   <features>
Oct 30 09:24:17 user nova-compute[75017]:     <acpi/>
Oct 30 09:24:17 user nova-compute[75017]:     <apic/>
Oct 30 09:24:17 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:24:17 user nova-compute[75017]:   </features>
Oct 30 09:24:17 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:24:17 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:24:17 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:24:17 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:24:17 user nova-compute[75017]:   </clock>
Oct 30 09:24:17 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:24:17 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:24:17 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:24:17 user nova-compute[75017]:   </cpu>
Oct 30 09:24:17 user nova-compute[75017]:   <devices>
Oct 30 09:24:17 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:24:17 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:24:17 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk"/>
Oct 30 09:24:17 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:24:17 user nova-compute[75017]:     </disk>
Oct 30 09:24:17 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:24:17 user nova-compute[75017]:       <mac address="fa:16:3e:9b:f9:ab"/>
Oct 30 09:24:17 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:24:17 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:24:17 user nova-compute[75017]:       <target dev="tap7c7cadfe-ab"/>
Oct 30 09:24:17 user nova-compute[75017]:     </interface>
Oct 30 09:24:17 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:24:17 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/console.log" append="off"/>
Oct 30 09:24:17 user nova-compute[75017]:     </serial>
Oct 30 09:24:17 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:24:17 user nova-compute[75017]:     <video>
Oct 30 09:24:17 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:24:17 user nova-compute[75017]:     </video>
Oct 30 09:24:17 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:24:17 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:24:17 user nova-compute[75017]:     </rng>
Oct 30 09:24:17 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:24:17 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:24:17 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:24:17 user nova-compute[75017]:     </memballoon>
Oct 30 09:24:17 user nova-compute[75017]:   </devices>
Oct 30 09:24:17 user nova-compute[75017]: </domain>
Oct 30 09:24:17 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1925502918',display_name='tempest-AttachVolumeNegativeTest-server-1925502918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1925502918',id=28,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvFNW+FZCLIn9+XJyPTCsn1OYwfOdO0Rs+T0FcTUhCcW9miflNYxtwUrx8d69RVKnLRWIZkj3muQ2JctxSPHsc6phs5FoTjew4UMFhSLX9vGL85pDbZpMUh7tD4W3LLRQ==',key_name='tempest-keypair-1675761624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-ogwu60ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f9:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c7cadfe-ab46-4565-8b85-a5fcd123707c,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7cadfe-ab') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG os_vif [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f9:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c7cadfe-ab46-4565-8b85-a5fcd123707c,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7cadfe-ab') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c2aa38c-070f-561a-95f3-8aab54a4b0ee', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c7cadfe-ab, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c7cadfe-ab, col_values=(('qos', UUID('5b9ab1b6-457a-4d2e-9676-dfee113454ac')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c7cadfe-ab, col_values=(('external_ids', {'iface-id': '7c7cadfe-ab46-4565-8b85-a5fcd123707c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:f9:ab', 'vm-uuid': 'bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:24:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:17 user nova-compute[75017]: INFO os_vif [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f9:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c7cadfe-ab46-4565-8b85-a5fcd123707c,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7cadfe-ab')
Oct 30 09:24:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No VIF found with MAC fa:16:3e:9b:f9:ab, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG nova.network.neutron [req-49333fbe-e099-4883-a8fd-d98052ac8246 req-6829076a-beef-43a8-b31f-096177f99701 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Updated VIF entry in instance network info cache for port 7c7cadfe-ab46-4565-8b85-a5fcd123707c. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG nova.network.neutron [req-49333fbe-e099-4883-a8fd-d98052ac8246 req-6829076a-beef-43a8-b31f-096177f99701 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Updating instance_info_cache with network_info: [{"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-49333fbe-e099-4883-a8fd-d98052ac8246 req-6829076a-beef-43a8-b31f-096177f99701 service nova] Releasing lock "refresh_cache-bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-b88ee45e-cf79-4080-b91e-7418e847d56c req-957d7a19-4e19-47a1-a4e0-a554d40b9278 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b88ee45e-cf79-4080-b91e-7418e847d56c req-957d7a19-4e19-47a1-a4e0-a554d40b9278 service nova] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b88ee45e-cf79-4080-b91e-7418e847d56c req-957d7a19-4e19-47a1-a4e0-a554d40b9278 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b88ee45e-cf79-4080-b91e-7418e847d56c req-957d7a19-4e19-47a1-a4e0-a554d40b9278 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-b88ee45e-cf79-4080-b91e-7418e847d56c req-957d7a19-4e19-47a1-a4e0-a554d40b9278 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] No waiting events found dispatching network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:24:22 user nova-compute[75017]: WARNING nova.compute.manager [req-b88ee45e-cf79-4080-b91e-7418e847d56c req-957d7a19-4e19-47a1-a4e0-a554d40b9278 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received unexpected event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c for instance with vm_state building and task_state spawning.
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e4d89df-06f9-4982-95e3-db5aeac1f6cc req-86f7885d-2fb2-4374-b3a1-3307a1f665ca service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received event network-changed-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e4d89df-06f9-4982-95e3-db5aeac1f6cc req-86f7885d-2fb2-4374-b3a1-3307a1f665ca service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Refreshing instance network info cache due to event network-changed-693ab1d1-4966-4d21-b6e5-acc42f756616. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e4d89df-06f9-4982-95e3-db5aeac1f6cc req-86f7885d-2fb2-4374-b3a1-3307a1f665ca service nova] Acquiring lock "refresh_cache-e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e4d89df-06f9-4982-95e3-db5aeac1f6cc req-86f7885d-2fb2-4374-b3a1-3307a1f665ca service nova] Acquired lock "refresh_cache-e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.network.neutron [req-7e4d89df-06f9-4982-95e3-db5aeac1f6cc req-86f7885d-2fb2-4374-b3a1-3307a1f665ca service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Refreshing network info cache for port 693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-090da5f4-d1b1-4437-ba71-d7ff607560e0 req-f87a64b4-3fb4-49c4-8926-49d82cf43fa0 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-090da5f4-d1b1-4437-ba71-d7ff607560e0 req-f87a64b4-3fb4-49c4-8926-49d82cf43fa0 service nova] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-090da5f4-d1b1-4437-ba71-d7ff607560e0 req-f87a64b4-3fb4-49c4-8926-49d82cf43fa0 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-090da5f4-d1b1-4437-ba71-d7ff607560e0 req-f87a64b4-3fb4-49c4-8926-49d82cf43fa0 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-090da5f4-d1b1-4437-ba71-d7ff607560e0 req-f87a64b4-3fb4-49c4-8926-49d82cf43fa0 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] No waiting events found dispatching network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:24:22 user nova-compute[75017]: WARNING nova.compute.manager [req-090da5f4-d1b1-4437-ba71-d7ff607560e0 req-f87a64b4-3fb4-49c4-8926-49d82cf43fa0 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received unexpected event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c for instance with vm_state building and task_state spawning.
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:24:22 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Instance spawned successfully.
Oct 30 09:24:22 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:24:22 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7220MB free_disk=25.18035888671875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Applying migration context for instance 28c7433c-4edd-4d5b-8d9c-68308998a508 as it has an incoming, in-progress migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822. Migration status is finished {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 30 09:24:22 user nova-compute[75017]: INFO nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating resource usage from migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 3833002b-0acf-4093-8f10-097760487c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e44fccb6-efe6-461a-91d0-bf1628183258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f574374d-8672-4215-b099-2b663288f6ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:24:22 user nova-compute[75017]: INFO nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Took 6.56 seconds to spawn the instance on the hypervisor.
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e2abbf92-799d-4786-92f3-6310abeb534b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:24:22 user nova-compute[75017]: INFO nova.compute.manager [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Took 7.57 seconds to build instance.
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f6646074-001c-45cd-b48d-67ff7a3539ef tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.682s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.network.neutron [req-7e4d89df-06f9-4982-95e3-db5aeac1f6cc req-86f7885d-2fb2-4374-b3a1-3307a1f665ca service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Updated VIF entry in instance network info cache for port 693ab1d1-4966-4d21-b6e5-acc42f756616. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.network.neutron [req-7e4d89df-06f9-4982-95e3-db5aeac1f6cc req-86f7885d-2fb2-4374-b3a1-3307a1f665ca service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Updating instance_info_cache with network_info: [{"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e4d89df-06f9-4982-95e3-db5aeac1f6cc req-86f7885d-2fb2-4374-b3a1-3307a1f665ca service nova] Releasing lock "refresh_cache-e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG nova.objects.instance [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lazy-loading 'flavor' on Instance uuid e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.789s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.692s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:24:23 user nova-compute[75017]: INFO nova.compute.claims [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Claim successful on node user
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:23 user nova-compute[75017]: INFO nova.compute.manager [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Attaching volume 8fb8b553-33bf-471c-be3d-0a31327c0c5a to /dev/vdb
Oct 30 09:24:23 user nova-compute[75017]: DEBUG os_brick.utils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb1011-abb7-4c05-9362-420be9e1f89f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e55bb3-26e6-41fb-b2ef-4e74ce908813]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce89e70-5dcb-47d0-9074-135e18ebe050]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[06333080-8690-4339-bd8f-9321e6b5159c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:24:23 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5cfad9-3d35-499c-994e-ef8d16ed7463]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG os_brick.utils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Updating existing volume attachment record: aa8b99a7-3fdb-4cd7-8d0b-a33bacf0d16f {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG nova.network.neutron [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:24:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:24:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG nova.policy [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a5a90dea2584329b7baf5cb83236091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2479037737af4b3e925a3d8f99c638ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:24:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Creating image(s)
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "/opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "/opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.228s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk 1073741824" returned: 0 in 0.061s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG nova.network.neutron [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Successfully created port: 9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.219s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:24:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Cannot resize image /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Ensure instance console log exists: /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.network.neutron [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Successfully updated port: 9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "refresh_cache-e2abbf92-799d-4786-92f3-6310abeb534b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquired lock "refresh_cache-e2abbf92-799d-4786-92f3-6310abeb534b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.network.neutron [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-459f5692-4ea3-4efe-a5ba-c6df48b7db43 req-34e74579-4780-4ccd-b4e1-a399f1111454 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received event network-changed-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-459f5692-4ea3-4efe-a5ba-c6df48b7db43 req-34e74579-4780-4ccd-b4e1-a399f1111454 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Refreshing instance network info cache due to event network-changed-9479211b-0f43-425a-bee1-9db956bbb5a9. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-459f5692-4ea3-4efe-a5ba-c6df48b7db43 req-34e74579-4780-4ccd-b4e1-a399f1111454 service nova] Acquiring lock "refresh_cache-e2abbf92-799d-4786-92f3-6310abeb534b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:25 user nova-compute[75017]: DEBUG nova.network.neutron [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.network.neutron [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Updating instance_info_cache with network_info: [{"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Releasing lock "refresh_cache-e2abbf92-799d-4786-92f3-6310abeb534b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Instance network_info: |[{"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-459f5692-4ea3-4efe-a5ba-c6df48b7db43 req-34e74579-4780-4ccd-b4e1-a399f1111454 service nova] Acquired lock "refresh_cache-e2abbf92-799d-4786-92f3-6310abeb534b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.network.neutron [req-459f5692-4ea3-4efe-a5ba-c6df48b7db43 req-34e74579-4780-4ccd-b4e1-a399f1111454 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Refreshing network info cache for port 9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Start _get_guest_xml network_info=[{"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:24:26 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:24:26 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1723183146',display_name='tempest-VolumesSnapshotTestJSON-instance-1723183146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1723183146',id=29,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHnJFuW9XNX099FRzqFWVBkAg6GbW915a7VjJhDfpv9H/7pu4Vvk9i2ICJ3AlA3a18aQMmqj1+01egS0jX63x+mRo4G8NqsrvQCiIfpDvarMyj1+FHdgWfiZoyl4Gw+8A==',key_name='tempest-keypair-1319410690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2479037737af4b3e925a3d8f99c638ff',ramdisk_id='',reservation_id='r-f4clqtx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-681659515',owner_user_name='tempest-VolumesSnapshotTestJSON-681659515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5a90dea2584329b7baf5cb83236091',uuid=e2abbf92-799d-4786-92f3-6310abeb534b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converting VIF {"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ea:e2,bridge_name='br-int',has_traffic_filtering=True,id=9479211b-0f43-425a-bee1-9db956bbb5a9,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9479211b-0f') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.objects.instance [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'pci_devices' on Instance uuid e2abbf92-799d-4786-92f3-6310abeb534b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:24:26 user nova-compute[75017]:   <uuid>e2abbf92-799d-4786-92f3-6310abeb534b</uuid>
Oct 30 09:24:26 user nova-compute[75017]:   <name>instance-0000001d</name>
Oct 30 09:24:26 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:24:26 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:24:26 user nova-compute[75017]:   <metadata>
Oct 30 09:24:26 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:24:26 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:24:26 user nova-compute[75017]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1723183146</nova:name>
Oct 30 09:24:26 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:24:26</nova:creationTime>
Oct 30 09:24:26 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:24:26 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:24:26 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:24:26 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:24:26 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:24:26 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:24:26 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:24:26 user nova-compute[75017]:       <nova:owner>
Oct 30 09:24:26 user nova-compute[75017]:         <nova:user uuid="3a5a90dea2584329b7baf5cb83236091">tempest-VolumesSnapshotTestJSON-681659515-project-member</nova:user>
Oct 30 09:24:26 user nova-compute[75017]:         <nova:project uuid="2479037737af4b3e925a3d8f99c638ff">tempest-VolumesSnapshotTestJSON-681659515</nova:project>
Oct 30 09:24:26 user nova-compute[75017]:       </nova:owner>
Oct 30 09:24:26 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:24:26 user nova-compute[75017]:       <nova:ports>
Oct 30 09:24:26 user nova-compute[75017]:         <nova:port uuid="9479211b-0f43-425a-bee1-9db956bbb5a9">
Oct 30 09:24:26 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:24:26 user nova-compute[75017]:         </nova:port>
Oct 30 09:24:26 user nova-compute[75017]:       </nova:ports>
Oct 30 09:24:26 user nova-compute[75017]:     </nova:instance>
Oct 30 09:24:26 user nova-compute[75017]:   </metadata>
Oct 30 09:24:26 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:24:26 user nova-compute[75017]:     <system>
Oct 30 09:24:26 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:24:26 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:24:26 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:24:26 user nova-compute[75017]:       <entry name="serial">e2abbf92-799d-4786-92f3-6310abeb534b</entry>
Oct 30 09:24:26 user nova-compute[75017]:       <entry name="uuid">e2abbf92-799d-4786-92f3-6310abeb534b</entry>
Oct 30 09:24:26 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:24:26 user nova-compute[75017]:     </system>
Oct 30 09:24:26 user nova-compute[75017]:   </sysinfo>
Oct 30 09:24:26 user nova-compute[75017]:   <os>
Oct 30 09:24:26 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:24:26 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:24:26 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:24:26 user nova-compute[75017]:   </os>
Oct 30 09:24:26 user nova-compute[75017]:   <features>
Oct 30 09:24:26 user nova-compute[75017]:     <acpi/>
Oct 30 09:24:26 user nova-compute[75017]:     <apic/>
Oct 30 09:24:26 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:24:26 user nova-compute[75017]:   </features>
Oct 30 09:24:26 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:24:26 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:24:26 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:24:26 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:24:26 user nova-compute[75017]:   </clock>
Oct 30 09:24:26 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:24:26 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:24:26 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:24:26 user nova-compute[75017]:   </cpu>
Oct 30 09:24:26 user nova-compute[75017]:   <devices>
Oct 30 09:24:26 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:24:26 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:24:26 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk"/>
Oct 30 09:24:26 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:24:26 user nova-compute[75017]:     </disk>
Oct 30 09:24:26 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:24:26 user nova-compute[75017]:       <mac address="fa:16:3e:c6:ea:e2"/>
Oct 30 09:24:26 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:24:26 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:24:26 user nova-compute[75017]:       <target dev="tap9479211b-0f"/>
Oct 30 09:24:26 user nova-compute[75017]:     </interface>
Oct 30 09:24:26 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:24:26 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/console.log" append="off"/>
Oct 30 09:24:26 user nova-compute[75017]:     </serial>
Oct 30 09:24:26 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:24:26 user nova-compute[75017]:     <video>
Oct 30 09:24:26 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:24:26 user nova-compute[75017]:     </video>
Oct 30 09:24:26 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:24:26 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:24:26 user nova-compute[75017]:     </rng>
Oct 30 09:24:26 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:24:26 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:24:26 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:24:26 user nova-compute[75017]:     </memballoon>
Oct 30 09:24:26 user nova-compute[75017]:   </devices>
Oct 30 09:24:26 user nova-compute[75017]: </domain>
Oct 30 09:24:26 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1723183146',display_name='tempest-VolumesSnapshotTestJSON-instance-1723183146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1723183146',id=29,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHnJFuW9XNX099FRzqFWVBkAg6GbW915a7VjJhDfpv9H/7pu4Vvk9i2ICJ3AlA3a18aQMmqj1+01egS0jX63x+mRo4G8NqsrvQCiIfpDvarMyj1+FHdgWfiZoyl4Gw+8A==',key_name='tempest-keypair-1319410690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2479037737af4b3e925a3d8f99c638ff',ramdisk_id='',reservation_id='r-f4clqtx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-681659515',owner_user_name='tempest-VolumesSnapshotTestJSON-681659515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5a90dea2584329b7baf5cb83236091',uuid=e2abbf92-799d-4786-92f3-6310abeb534b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converting VIF {"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ea:e2,bridge_name='br-int',has_traffic_filtering=True,id=9479211b-0f43-425a-bee1-9db956bbb5a9,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9479211b-0f') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG os_vif [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ea:e2,bridge_name='br-int',has_traffic_filtering=True,id=9479211b-0f43-425a-bee1-9db956bbb5a9,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9479211b-0f') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4d7e7b9-2bd0-5d00-b9d4-dc74e8e2d275', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9479211b-0f, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9479211b-0f, col_values=(('qos', UUID('0634607f-6810-4c62-8bf3-f3ee2ca99d1c')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9479211b-0f, col_values=(('external_ids', {'iface-id': '9479211b-0f43-425a-bee1-9db956bbb5a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:ea:e2', 'vm-uuid': 'e2abbf92-799d-4786-92f3-6310abeb534b'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:26 user nova-compute[75017]: INFO os_vif [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ea:e2,bridge_name='br-int',has_traffic_filtering=True,id=9479211b-0f43-425a-bee1-9db956bbb5a9,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9479211b-0f')
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No VIF found with MAC fa:16:3e:c6:ea:e2, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.network.neutron [req-459f5692-4ea3-4efe-a5ba-c6df48b7db43 req-34e74579-4780-4ccd-b4e1-a399f1111454 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Updated VIF entry in instance network info cache for port 9479211b-0f43-425a-bee1-9db956bbb5a9. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG nova.network.neutron [req-459f5692-4ea3-4efe-a5ba-c6df48b7db43 req-34e74579-4780-4ccd-b4e1-a399f1111454 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Updating instance_info_cache with network_info: [{"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-459f5692-4ea3-4efe-a5ba-c6df48b7db43 req-34e74579-4780-4ccd-b4e1-a399f1111454 service nova] Releasing lock "refresh_cache-e2abbf92-799d-4786-92f3-6310abeb534b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:24:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a7474bc1-0207-4b17-98f1-65a38a8611c3 req-f490cc13-50b7-410d-9f55-8eed55b5df8f service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received event network-vif-plugged-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a7474bc1-0207-4b17-98f1-65a38a8611c3 req-f490cc13-50b7-410d-9f55-8eed55b5df8f service nova] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a7474bc1-0207-4b17-98f1-65a38a8611c3 req-f490cc13-50b7-410d-9f55-8eed55b5df8f service nova] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a7474bc1-0207-4b17-98f1-65a38a8611c3 req-f490cc13-50b7-410d-9f55-8eed55b5df8f service nova] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-a7474bc1-0207-4b17-98f1-65a38a8611c3 req-f490cc13-50b7-410d-9f55-8eed55b5df8f service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] No waiting events found dispatching network-vif-plugged-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:24:28 user nova-compute[75017]: WARNING nova.compute.manager [req-a7474bc1-0207-4b17-98f1-65a38a8611c3 req-f490cc13-50b7-410d-9f55-8eed55b5df8f service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received unexpected event network-vif-plugged-9479211b-0f43-425a-bee1-9db956bbb5a9 for instance with vm_state building and task_state spawning.
Oct 30 09:24:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-036fd6d9-704b-47c6-8735-9fad5065872a req-c5f45c56-f640-4e9e-ab4d-76e6b168f8ac service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received event network-vif-plugged-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-036fd6d9-704b-47c6-8735-9fad5065872a req-c5f45c56-f640-4e9e-ab4d-76e6b168f8ac service nova] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-036fd6d9-704b-47c6-8735-9fad5065872a req-c5f45c56-f640-4e9e-ab4d-76e6b168f8ac service nova] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-036fd6d9-704b-47c6-8735-9fad5065872a req-c5f45c56-f640-4e9e-ab4d-76e6b168f8ac service nova] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-036fd6d9-704b-47c6-8735-9fad5065872a req-c5f45c56-f640-4e9e-ab4d-76e6b168f8ac service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] No waiting events found dispatching network-vif-plugged-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:24:30 user nova-compute[75017]: WARNING nova.compute.manager [req-036fd6d9-704b-47c6-8735-9fad5065872a req-c5f45c56-f640-4e9e-ab4d-76e6b168f8ac service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received unexpected event network-vif-plugged-9479211b-0f43-425a-bee1-9db956bbb5a9 for instance with vm_state building and task_state spawning.
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:24:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Instance spawned successfully.
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:30 user nova-compute[75017]: INFO nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Took 6.45 seconds to spawn the instance on the hypervisor.
Oct 30 09:24:30 user nova-compute[75017]: DEBUG nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:24:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:30 user nova-compute[75017]: INFO nova.compute.manager [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Took 8.41 seconds to build instance.
Oct 30 09:24:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af1dd902-1bf2-4e80-bd3d-d0a2c06634bb tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.535s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "4736b80b-55ba-4267-8834-b1a12af3e164" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "4736b80b-55ba-4267-8834-b1a12af3e164" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:24:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:24:31 user nova-compute[75017]: INFO nova.compute.claims [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Claim successful on node user
Oct 30 09:24:32 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:24:32 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:24:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.690s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:24:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:24:32 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:24:32 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:24:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:24:32 user nova-compute[75017]: DEBUG nova.policy [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '257ef30aa08d49a387932c340a8589c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20765fc27454d25a1f53e540a8cb4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:24:32 user nova-compute[75017]: INFO nova.virt.block_device [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Booting with volume e3621e94-2e4b-4100-8fb0-c6791baff6a6 at /dev/vda
Oct 30 09:24:32 user nova-compute[75017]: DEBUG os_brick.utils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:24:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[098aa119-76cf-435a-8908-e8ae528c5445]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[efff5e75-04ae-4ad2-966c-3542a0ba5236]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[af37769b-ffd1-4dca-bda1-564c9de05917]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cbca97-07b6-4593-ae48-4691acb48357]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:24:33 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:24:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bdfd70-d57d-493d-9752-c59cd93772d5]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG os_brick.utils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Updating existing volume attachment record: b496745c-9662-4c8f-ae06-d5967482faab {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:24:33 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Successfully created port: ff48b2c6-5584-479e-9f58-36065319038a {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:24:34 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3833002b-0acf-4093-8f10-097760487c73 is timed out.
Oct 30 09:24:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Successfully detached device vdb from instance 3833002b-0acf-4093-8f10-097760487c73 from the live domain config.
Oct 30 09:24:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnApGoTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:24:34 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3cd68a-8342-4bbf-8169-ceea7bf32e80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:24:34 user nova-compute[75017]: No targets found.
Oct 30 09:24:34 user nova-compute[75017]: iSNS:
Oct 30 09:24:34 user nova-compute[75017]: No targets found.
Oct 30 09:24:34 user nova-compute[75017]: STATIC:
Oct 30 09:24:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54
Oct 30 09:24:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:24:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:24:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef
Oct 30 09:24:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:24:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:24:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:24:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:24:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:24:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361
Oct 30 09:24:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:24:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:24:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b
Oct 30 09:24:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:24:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:24:34 user nova-compute[75017]: FIRMWARE:
Oct 30 09:24:34 user nova-compute[75017]: No targets found.
Oct 30 09:24:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:24:34 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:24:34 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c49be87-8b7c-40ca-8d18-4c294408b00a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7033e22-d739-4f0b-ad58-31dc247baef3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:24:34 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:24:34 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:24:34 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:24:34 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:24:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 (non-flash)
Oct 30 09:24:34 user nova-compute[75017]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:24:34 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:24:34 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:24:34 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:24:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ccceaedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361'): ({'sde'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Removing single pathed devices sde {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f72c90-5cf9-4dda-8a65-685d1682c93f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c521bc05-4b5f-434a-aa53-464e07372899]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Flushing IO for device /dev/sde {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fa1c5a-4c6a-4014-a683-26e6c80d76aa]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[978f35e3-a370-4106-92e8-d2b18896edb4]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af76b06-e6b7-48f7-a522-aa6fd5b7aaac]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef10f865-80b4-4900-92cf-5b625e620692]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361, portal: 172.16.0.220,3260]
Oct 30 09:24:34 user nova-compute[75017]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361, portal: 172.16.0.220,3260] successful.
Oct 30 09:24:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7575e8ce-b5de-4c95-b017-0d73b0113361 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[911229ae-4aaf-4732-9372-4e2714866cfa]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] <== disconnect_volume: return (446ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Successfully updated port: ff48b2c6-5584-479e-9f58-36065319038a {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "refresh_cache-4736b80b-55ba-4267-8834-b1a12af3e164" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquired lock "refresh_cache-4736b80b-55ba-4267-8834-b1a12af3e164" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-ced384c3-e5f5-4cc7-a057-99efe9b4a916 req-5d44bfaf-d0d0-4722-9c8f-eecc0d066635 service nova] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Received event network-changed-ff48b2c6-5584-479e-9f58-36065319038a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-ced384c3-e5f5-4cc7-a057-99efe9b4a916 req-5d44bfaf-d0d0-4722-9c8f-eecc0d066635 service nova] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Refreshing instance network info cache due to event network-changed-ff48b2c6-5584-479e-9f58-36065319038a. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ced384c3-e5f5-4cc7-a057-99efe9b4a916 req-5d44bfaf-d0d0-4722-9c8f-eecc0d066635 service nova] Acquiring lock "refresh_cache-4736b80b-55ba-4267-8834-b1a12af3e164" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:24:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.volume.cinder [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Update attachment failed for attachment b496745c-9662-4c8f-ae06-d5967482faab. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-207d2a2e-e536-4204-b2f6-6ab1399ea5bb) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-207d2a2e-e536-4204-b2f6-6ab1399ea5bb)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-207d2a2e-e536-4204-b2f6-6ab1399ea5bb)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Traceback (most recent call last):
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     driver_block_device.attach_block_devices(
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     _log_and_attach(device)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     bdm.attach(*attach_args, **attach_kwargs)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     ret_val = method(obj, context, *args, **kwargs)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     self._do_attach(context, instance, volume, volume_api,
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     self._volume_attach(context, volume, connector, instance,
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     connection_info = volume_api.attachment_update(
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     res = method(self, ctx, *args, **kwargs)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     with excutils.save_and_reraise_exception():
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     self.force_reraise()
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     raise self.value
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     context, '3.44', skip_version_check=True).attachments.update(
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     return method.func(obj, *args, **kwargs)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     resp = self._update('/attachments/%s' % id, body)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     return self._cs_request(url, 'PUT', **kwargs)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     return self.request(url, method, **kwargs)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164]     raise exceptions.from_response(resp, body)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-207d2a2e-e536-4204-b2f6-6ab1399ea5bb)
Oct 30 09:24:35 user nova-compute[75017]: ERROR nova.compute.manager [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] 
Oct 30 09:24:35 user nova-compute[75017]: DEBUG nova.objects.instance [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'flavor' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:24:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-aa471911-f56f-4efa-9973-7bfc0956732e tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.388s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Updating instance_info_cache with network_info: [{"id": "ff48b2c6-5584-479e-9f58-36065319038a", "address": "fa:16:3e:40:df:2b", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff48b2c6-55", "ovs_interfaceid": "ff48b2c6-5584-479e-9f58-36065319038a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Releasing lock "refresh_cache-4736b80b-55ba-4267-8834-b1a12af3e164" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Instance network_info: |[{"id": "ff48b2c6-5584-479e-9f58-36065319038a", "address": "fa:16:3e:40:df:2b", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff48b2c6-55", "ovs_interfaceid": "ff48b2c6-5584-479e-9f58-36065319038a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ced384c3-e5f5-4cc7-a057-99efe9b4a916 req-5d44bfaf-d0d0-4722-9c8f-eecc0d066635 service nova] Acquired lock "refresh_cache-4736b80b-55ba-4267-8834-b1a12af3e164" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-ced384c3-e5f5-4cc7-a057-99efe9b4a916 req-5d44bfaf-d0d0-4722-9c8f-eecc0d066635 service nova] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Refreshing network info cache for port ff48b2c6-5584-479e-9f58-36065319038a {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.compute.claims [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Aborting claim: <nova.compute.claims.Claim object at 0x7f7cccb2d4e0> {{(pid=75017) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-ced384c3-e5f5-4cc7-a057-99efe9b4a916 req-5d44bfaf-d0d0-4722-9c8f-eecc0d066635 service nova] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Updated VIF entry in instance network info cache for port ff48b2c6-5584-479e-9f58-36065319038a. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-ced384c3-e5f5-4cc7-a057-99efe9b4a916 req-5d44bfaf-d0d0-4722-9c8f-eecc0d066635 service nova] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Updating instance_info_cache with network_info: [{"id": "ff48b2c6-5584-479e-9f58-36065319038a", "address": "fa:16:3e:40:df:2b", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff48b2c6-55", "ovs_interfaceid": "ff48b2c6-5584-479e-9f58-36065319038a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ced384c3-e5f5-4cc7-a057-99efe9b4a916 req-5d44bfaf-d0d0-4722-9c8f-eecc0d066635 service nova] Releasing lock "refresh_cache-4736b80b-55ba-4267-8834-b1a12af3e164" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.667s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Build of instance 4736b80b-55ba-4267-8834-b1a12af3e164 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-207d2a2e-e536-4204-b2f6-6ab1399ea5bb) {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.compute.utils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Build of instance 4736b80b-55ba-4267-8834-b1a12af3e164 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75017) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 30 09:24:36 user nova-compute[75017]: ERROR nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Build of instance 4736b80b-55ba-4267-8834-b1a12af3e164 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-207d2a2e-e536-4204-b2f6-6ab1399ea5bb): nova.exception.BuildAbortException: Build of instance 4736b80b-55ba-4267-8834-b1a12af3e164 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-207d2a2e-e536-4204-b2f6-6ab1399ea5bb)
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Unplugging VIFs for instance {{(pid=75017) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1385407941',display_name='tempest-ServerActionsTestOtherA-server-1385407941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1385407941',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVf6zqMoogIIj/uVm0rJdIGAUOFQTJWmuf99t8ZCINTOFKb0EfkIlJX2kMG++VhQZ9/3YDSeCpCZrAjAjPqkbtlMQdQ8cwrIE78waAfMQ+vnF0Yf8L48jhmZjd9BMvMIA==',key_name='tempest-keypair-2124767111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-p8k7us23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=4736b80b-55ba-4267-8834-b1a12af3e164,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff48b2c6-5584-479e-9f58-36065319038a", "address": "fa:16:3e:40:df:2b", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff48b2c6-55", "ovs_interfaceid": "ff48b2c6-5584-479e-9f58-36065319038a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "ff48b2c6-5584-479e-9f58-36065319038a", "address": "fa:16:3e:40:df:2b", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff48b2c6-55", "ovs_interfaceid": "ff48b2c6-5584-479e-9f58-36065319038a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:df:2b,bridge_name='br-int',has_traffic_filtering=True,id=ff48b2c6-5584-479e-9f58-36065319038a,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff48b2c6-55') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG os_vif [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:df:2b,bridge_name='br-int',has_traffic_filtering=True,id=ff48b2c6-5584-479e-9f58-36065319038a,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff48b2c6-55') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff48b2c6-55, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:24:36 user nova-compute[75017]: INFO os_vif [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:df:2b,bridge_name='br-int',has_traffic_filtering=True,id=ff48b2c6-5584-479e-9f58-36065319038a,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff48b2c6-55')
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Unplugged VIFs for instance {{(pid=75017) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:24:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:24:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:37 user nova-compute[75017]: INFO nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Took 0.59 seconds to deallocate network for instance.
Oct 30 09:24:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Detaching volume: e3621e94-2e4b-4100-8fb0-c6791baff6a6 {{(pid=75017) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 30 09:24:37 user nova-compute[75017]: INFO nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Detaching volume e3621e94-2e4b-4100-8fb0-c6791baff6a6
Oct 30 09:24:37 user nova-compute[75017]: ERROR nova.virt.block_device [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Unable to call for a driver detach of volume e3621e94-2e4b-4100-8fb0-c6791baff6a6 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 4736b80b-55ba-4267-8834-b1a12af3e164 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-207d2a2e-e536-4204-b2f6-6ab1399ea5bb)
Oct 30 09:24:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 4736b80b-55ba-4267-8834-b1a12af3e164] Deleting volume: e3621e94-2e4b-4100-8fb0-c6791baff6a6 {{(pid=75017) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 09:24:38 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Deleted allocations for instance 4736b80b-55ba-4267-8834-b1a12af3e164
Oct 30 09:24:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8ecbeb83-4826-4df8-a927-6c47c9e44f97 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "4736b80b-55ba-4267-8834-b1a12af3e164" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.337s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziJKvdXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:24:46 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:24:46 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:24:46 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b747da9-93f1-4912-bc62-befa5cfadb1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:24:46 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d1bf27-9554-466c-b3b4-b2ee378b9ebc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a] added
Oct 30 09:24:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[845ab2a7-778d-4a74-971e-99683dc393c6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabdcb8f-6c13-45f7-bc44-55e26824f146]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziJKvdXh {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziJKvdXh" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a60399-a106-4f64-8da3-99752d60b1ec]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ziJKvdXh'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5444c39a-4b53-4f2e-8b99-317122c595dd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[267a0049-469f-42d2-9c30-a6f2fd44d752]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:24:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:24:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f163fdb-6dbc-46d2-9ba6-26e9435aedd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a, portal: 172.16.0.220,3260]
Oct 30 09:24:47 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a, portal: 172.16.0.220,3260] successful.
Oct 30 09:24:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c85ef7e-c794-41fc-9c07-f044a4303574]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d294a9-638e-4b03-9d7a-9bc470e0945d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:24:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:24:47 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:24:47 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af99b45-d41c-460f-9894-9ceebacf9852]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:24:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziJKvdXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:24:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:24:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23063323864353266', 'path': '/dev/sde'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:24:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063323864353266', 'path': '/dev/sde'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:24:48 user nova-compute[75017]: DEBUG nova.objects.instance [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lazy-loading 'flavor' on Instance uuid e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:24:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:24:48 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:24:48 user nova-compute[75017]:   <source dev="/dev/sde"/>
Oct 30 09:24:48 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:24:48 user nova-compute[75017]:   <serial>8fb8b553-33bf-471c-be3d-0a31327c0c5a</serial>
Oct 30 09:24:48 user nova-compute[75017]: </disk>
Oct 30 09:24:48 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:24:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:24:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:24:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] No VIF found with MAC fa:16:3e:32:a2:a2, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:24:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-40368902-c53c-449b-bb20-3c2785ac2852 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.679s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:51 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:24:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:51 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:24:51 user nova-compute[75017]: INFO nova.compute.claims [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Claim successful on node user
Oct 30 09:24:52 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:24:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:24:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG nova.policy [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7b340dac0544150bc642f7ecfb07157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1e0e03de5c497a94c9c6267e623573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:24:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Creating image(s)
Oct 30 09:24:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.232s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.237s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk 1073741824" returned: 0 in 0.058s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Successfully created port: 9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Cannot resize image /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Ensure instance console log exists: /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.objects.instance [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lazy-loading 'flavor' on Instance uuid e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Successfully updated port: 9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquired lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-388aa14f-f76f-412d-80e3-7f872fb92e8c req-16410598-c2b4-498c-ba09-fffbf0fe8a51 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-changed-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-388aa14f-f76f-412d-80e3-7f872fb92e8c req-16410598-c2b4-498c-ba09-fffbf0fe8a51 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Refreshing instance network info cache due to event network-changed-9705cc2d-9b13-4281-ad14-89ecc4a8cb48. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-388aa14f-f76f-412d-80e3-7f872fb92e8c req-16410598-c2b4-498c-ba09-fffbf0fe8a51 service nova] Acquiring lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:54 user nova-compute[75017]: INFO nova.compute.manager [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Attaching volume b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 to /dev/vdc
Oct 30 09:24:54 user nova-compute[75017]: DEBUG os_brick.utils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c995337d-17b0-40b1-8886-1b27d659b86c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4714812-1942-4992-8539-fbda686532ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[176947e7-3596-4935-b75f-039804e30d99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc3fbe9-3256-4067-a165-c9d8d732fa38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:24:54 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[641d6821-4d66-472f-8f3a-6446a96851fa]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG os_brick.utils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Updating existing volume attachment record: 825821f8-3801-41a3-afc6-7be9aa0c6650 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating instance_info_cache with network_info: [{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Releasing lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Instance network_info: |[{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-388aa14f-f76f-412d-80e3-7f872fb92e8c req-16410598-c2b4-498c-ba09-fffbf0fe8a51 service nova] Acquired lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.network.neutron [req-388aa14f-f76f-412d-80e3-7f872fb92e8c req-16410598-c2b4-498c-ba09-fffbf0fe8a51 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Refreshing network info cache for port 9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Start _get_guest_xml network_info=[{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:24:54 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:24:54 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1156699622',display_name='tempest-ServerRescueNegativeTestJSON-server-1156699622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1156699622',id=31,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiHkKVhHb4iClThemee7bcrZuhx1I0GTqPzFzJCYdqnn/591lr36roMoemqs/9t5XrCdCtjnGaSJ1MgJu8w59mmdzFwcuHWexzVhY1j8x7K4JD2IYmVciSWDWtJo80Riw==',key_name='tempest-keypair-409353962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-5u4n2omd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b340dac0544150bc642f7ecfb07157',uuid=1af08de5-92f6-44fc-aa50-0130c5068105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c8:de,bridge_name='br-int',has_traffic_filtering=True,id=9705cc2d-9b13-4281-ad14-89ecc4a8cb48,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9705cc2d-9b') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:24:54 user nova-compute[75017]: DEBUG nova.objects.instance [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'pci_devices' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:24:55 user nova-compute[75017]:   <uuid>1af08de5-92f6-44fc-aa50-0130c5068105</uuid>
Oct 30 09:24:55 user nova-compute[75017]:   <name>instance-0000001f</name>
Oct 30 09:24:55 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:24:55 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:24:55 user nova-compute[75017]:   <metadata>
Oct 30 09:24:55 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:24:55 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:24:55 user nova-compute[75017]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1156699622</nova:name>
Oct 30 09:24:55 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:24:54</nova:creationTime>
Oct 30 09:24:55 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:24:55 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:24:55 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:24:55 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:24:55 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:24:55 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:24:55 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:24:55 user nova-compute[75017]:       <nova:owner>
Oct 30 09:24:55 user nova-compute[75017]:         <nova:user uuid="e7b340dac0544150bc642f7ecfb07157">tempest-ServerRescueNegativeTestJSON-1002551965-project-member</nova:user>
Oct 30 09:24:55 user nova-compute[75017]:         <nova:project uuid="8c1e0e03de5c497a94c9c6267e623573">tempest-ServerRescueNegativeTestJSON-1002551965</nova:project>
Oct 30 09:24:55 user nova-compute[75017]:       </nova:owner>
Oct 30 09:24:55 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:24:55 user nova-compute[75017]:       <nova:ports>
Oct 30 09:24:55 user nova-compute[75017]:         <nova:port uuid="9705cc2d-9b13-4281-ad14-89ecc4a8cb48">
Oct 30 09:24:55 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 09:24:55 user nova-compute[75017]:         </nova:port>
Oct 30 09:24:55 user nova-compute[75017]:       </nova:ports>
Oct 30 09:24:55 user nova-compute[75017]:     </nova:instance>
Oct 30 09:24:55 user nova-compute[75017]:   </metadata>
Oct 30 09:24:55 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:24:55 user nova-compute[75017]:     <system>
Oct 30 09:24:55 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:24:55 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:24:55 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:24:55 user nova-compute[75017]:       <entry name="serial">1af08de5-92f6-44fc-aa50-0130c5068105</entry>
Oct 30 09:24:55 user nova-compute[75017]:       <entry name="uuid">1af08de5-92f6-44fc-aa50-0130c5068105</entry>
Oct 30 09:24:55 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:24:55 user nova-compute[75017]:     </system>
Oct 30 09:24:55 user nova-compute[75017]:   </sysinfo>
Oct 30 09:24:55 user nova-compute[75017]:   <os>
Oct 30 09:24:55 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:24:55 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:24:55 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:24:55 user nova-compute[75017]:   </os>
Oct 30 09:24:55 user nova-compute[75017]:   <features>
Oct 30 09:24:55 user nova-compute[75017]:     <acpi/>
Oct 30 09:24:55 user nova-compute[75017]:     <apic/>
Oct 30 09:24:55 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:24:55 user nova-compute[75017]:   </features>
Oct 30 09:24:55 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:24:55 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:24:55 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:24:55 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:24:55 user nova-compute[75017]:   </clock>
Oct 30 09:24:55 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:24:55 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:24:55 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:24:55 user nova-compute[75017]:   </cpu>
Oct 30 09:24:55 user nova-compute[75017]:   <devices>
Oct 30 09:24:55 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:24:55 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:24:55 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk"/>
Oct 30 09:24:55 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:24:55 user nova-compute[75017]:     </disk>
Oct 30 09:24:55 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:24:55 user nova-compute[75017]:       <mac address="fa:16:3e:1d:c8:de"/>
Oct 30 09:24:55 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:24:55 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:24:55 user nova-compute[75017]:       <target dev="tap9705cc2d-9b"/>
Oct 30 09:24:55 user nova-compute[75017]:     </interface>
Oct 30 09:24:55 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:24:55 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/console.log" append="off"/>
Oct 30 09:24:55 user nova-compute[75017]:     </serial>
Oct 30 09:24:55 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:24:55 user nova-compute[75017]:     <video>
Oct 30 09:24:55 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:24:55 user nova-compute[75017]:     </video>
Oct 30 09:24:55 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:24:55 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:24:55 user nova-compute[75017]:     </rng>
Oct 30 09:24:55 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:24:55 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:24:55 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:24:55 user nova-compute[75017]:     </memballoon>
Oct 30 09:24:55 user nova-compute[75017]:   </devices>
Oct 30 09:24:55 user nova-compute[75017]: </domain>
Oct 30 09:24:55 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1156699622',display_name='tempest-ServerRescueNegativeTestJSON-server-1156699622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1156699622',id=31,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiHkKVhHb4iClThemee7bcrZuhx1I0GTqPzFzJCYdqnn/591lr36roMoemqs/9t5XrCdCtjnGaSJ1MgJu8w59mmdzFwcuHWexzVhY1j8x7K4JD2IYmVciSWDWtJo80Riw==',key_name='tempest-keypair-409353962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-5u4n2omd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b340dac0544150bc642f7ecfb07157',uuid=1af08de5-92f6-44fc-aa50-0130c5068105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c8:de,bridge_name='br-int',has_traffic_filtering=True,id=9705cc2d-9b13-4281-ad14-89ecc4a8cb48,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9705cc2d-9b') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG os_vif [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c8:de,bridge_name='br-int',has_traffic_filtering=True,id=9705cc2d-9b13-4281-ad14-89ecc4a8cb48,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9705cc2d-9b') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0aa48f20-d4ef-5042-b418-141235067ebd', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9705cc2d-9b, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9705cc2d-9b, col_values=(('qos', UUID('96a4bc1e-4e5a-4fbb-8ad5-f6b5b4b06eff')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9705cc2d-9b, col_values=(('external_ids', {'iface-id': '9705cc2d-9b13-4281-ad14-89ecc4a8cb48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:c8:de', 'vm-uuid': '1af08de5-92f6-44fc-aa50-0130c5068105'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:55 user nova-compute[75017]: INFO os_vif [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c8:de,bridge_name='br-int',has_traffic_filtering=True,id=9705cc2d-9b13-4281-ad14-89ecc4a8cb48,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9705cc2d-9b')
Oct 30 09:24:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No VIF found with MAC fa:16:3e:1d:c8:de, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG nova.network.neutron [req-388aa14f-f76f-412d-80e3-7f872fb92e8c req-16410598-c2b4-498c-ba09-fffbf0fe8a51 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updated VIF entry in instance network info cache for port 9705cc2d-9b13-4281-ad14-89ecc4a8cb48. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG nova.network.neutron [req-388aa14f-f76f-412d-80e3-7f872fb92e8c req-16410598-c2b4-498c-ba09-fffbf0fe8a51 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating instance_info_cache with network_info: [{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-388aa14f-f76f-412d-80e3-7f872fb92e8c req-16410598-c2b4-498c-ba09-fffbf0fe8a51 service nova] Releasing lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:24:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-2e98994a-64bd-4502-bd41-6366c0aa21d9 req-d12df707-f4dd-4933-97ec-182f300b8124 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2e98994a-64bd-4502-bd41-6366c0aa21d9 req-d12df707-f4dd-4933-97ec-182f300b8124 service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2e98994a-64bd-4502-bd41-6366c0aa21d9 req-d12df707-f4dd-4933-97ec-182f300b8124 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2e98994a-64bd-4502-bd41-6366c0aa21d9 req-d12df707-f4dd-4933-97ec-182f300b8124 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-2e98994a-64bd-4502-bd41-6366c0aa21d9 req-d12df707-f4dd-4933-97ec-182f300b8124 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:24:56 user nova-compute[75017]: WARNING nova.compute.manager [req-2e98994a-64bd-4502-bd41-6366c0aa21d9 req-d12df707-f4dd-4933-97ec-182f300b8124 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state building and task_state spawning.
Oct 30 09:24:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:24:58 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Instance spawned successfully.
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6f62277-d142-4fc2-9355-554fce98d8ce req-f3f68f8d-b97a-4a19-b642-41cd6bc8131b service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f6f62277-d142-4fc2-9355-554fce98d8ce req-f3f68f8d-b97a-4a19-b642-41cd6bc8131b service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f6f62277-d142-4fc2-9355-554fce98d8ce req-f3f68f8d-b97a-4a19-b642-41cd6bc8131b service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f6f62277-d142-4fc2-9355-554fce98d8ce req-f3f68f8d-b97a-4a19-b642-41cd6bc8131b service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6f62277-d142-4fc2-9355-554fce98d8ce req-f3f68f8d-b97a-4a19-b642-41cd6bc8131b service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:24:58 user nova-compute[75017]: WARNING nova.compute.manager [req-f6f62277-d142-4fc2-9355-554fce98d8ce req-f3f68f8d-b97a-4a19-b642-41cd6bc8131b service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state building and task_state spawning.
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:24:58 user nova-compute[75017]: INFO nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Took 6.09 seconds to spawn the instance on the hypervisor.
Oct 30 09:24:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:24:58 user nova-compute[75017]: INFO nova.compute.manager [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Took 7.05 seconds to build instance.
Oct 30 09:24:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fb81666-b45a-4927-a6d9-7caa68d0016f tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.188s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:04 user nova-compute[75017]: INFO nova.compute.manager [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Terminating instance
Oct 30 09:25:04 user nova-compute[75017]: DEBUG nova.compute.manager [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-1a04ae86-8e6a-492d-ab2e-4002f6f61e51 req-ca8ab83a-3b23-41dd-9c26-bd585644e62d service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-unplugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1a04ae86-8e6a-492d-ab2e-4002f6f61e51 req-ca8ab83a-3b23-41dd-9c26-bd585644e62d service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1a04ae86-8e6a-492d-ab2e-4002f6f61e51 req-ca8ab83a-3b23-41dd-9c26-bd585644e62d service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1a04ae86-8e6a-492d-ab2e-4002f6f61e51 req-ca8ab83a-3b23-41dd-9c26-bd585644e62d service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-1a04ae86-8e6a-492d-ab2e-4002f6f61e51 req-ca8ab83a-3b23-41dd-9c26-bd585644e62d service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-unplugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-1a04ae86-8e6a-492d-ab2e-4002f6f61e51 req-ca8ab83a-3b23-41dd-9c26-bd585644e62d service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-unplugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 3833002b-0acf-4093-8f10-097760487c73] Instance destroyed successfully.
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.objects.instance [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lazy-loading 'resources' on Instance uuid 3833002b-0acf-4093-8f10-097760487c73 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1160586145',display_name='tempest-ServerStableDeviceRescueTest-server-1160586145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1160586145',id=17,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSUxx57TJQCELhTTTGOfSKVi1iHah3q8zrlE9funAUn/G+GFr2dU6QazUmdaKFAc8RhvFTpouaaDWbh+QWRPsz7Wow/dlb3QsDFKzkjY5ZvvR4TPfqcnmlkyiQWdvU9Uw==',key_name='tempest-keypair-2000133269',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e045f070c72c4a07b6041eba0e6bf7d0',ramdisk_id='',reservation_id='r-t70xmlyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1639847037',owner_user_name='tempest-ServerStableDeviceRescueTest-1639847037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8849a4cff6941638c2461918c305c86',uuid=3833002b-0acf-4093-8f10-097760487c73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Converting VIF {"id": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "address": "fa:16:3e:7a:7e:05", "network": {"id": "935757fd-d9bf-4b7f-9a46-6479e87f7071", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-194463551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e045f070c72c4a07b6041eba0e6bf7d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2b14a4-3e", "ovs_interfaceid": "8a2b14a4-3ecb-4c54-ac67-7917a612e660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=8a2b14a4-3ecb-4c54-ac67-7917a612e660,network=Network(935757fd-d9bf-4b7f-9a46-6479e87f7071),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2b14a4-3e') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG os_vif [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=8a2b14a4-3ecb-4c54-ac67-7917a612e660,network=Network(935757fd-d9bf-4b7f-9a46-6479e87f7071),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2b14a4-3e') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a2b14a4-3e, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=952f54d6-e038-42c1-a4d6-7943ae1f481e) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:05 user nova-compute[75017]: INFO os_vif [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=8a2b14a4-3ecb-4c54-ac67-7917a612e660,network=Network(935757fd-d9bf-4b7f-9a46-6479e87f7071),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2b14a4-3e')
Oct 30 09:25:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Deleting instance files /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73_del
Oct 30 09:25:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Deletion of /opt/stack/data/nova/instances/3833002b-0acf-4093-8f10-097760487c73_del complete
Oct 30 09:25:05 user nova-compute[75017]: INFO nova.compute.manager [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] [instance: 3833002b-0acf-4093-8f10-097760487c73] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 30 09:25:05 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 3833002b-0acf-4093-8f10-097760487c73] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 3833002b-0acf-4093-8f10-097760487c73] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-92726d32-468f-4c32-b22c-c8e8333c7bf1 req-e6ae0d81-9ae1-4aef-94a5-c7745eb83d4b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-deleted-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:05 user nova-compute[75017]: INFO nova.compute.manager [req-92726d32-468f-4c32-b22c-c8e8333c7bf1 req-e6ae0d81-9ae1-4aef-94a5-c7745eb83d4b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Neutron deleted interface 8a2b14a4-3ecb-4c54-ac67-7917a612e660; detaching it from the instance and deleting it from the info cache
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.network.neutron [req-92726d32-468f-4c32-b22c-c8e8333c7bf1 req-e6ae0d81-9ae1-4aef-94a5-c7745eb83d4b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:05 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 3833002b-0acf-4093-8f10-097760487c73] Took 0.78 seconds to deallocate network for instance.
Oct 30 09:25:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-92726d32-468f-4c32-b22c-c8e8333c7bf1 req-e6ae0d81-9ae1-4aef-94a5-c7745eb83d4b service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Detach interface failed, port_id=8a2b14a4-3ecb-4c54-ac67-7917a612e660, reason: Instance 3833002b-0acf-4093-8f10-097760487c73 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:06 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Deleted allocations for instance 3833002b-0acf-4093-8f10-097760487c73
Oct 30 09:25:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42cf0cea-49a9-42f1-b822-2a7d846d12d7 tempest-ServerStableDeviceRescueTest-1639847037 tempest-ServerStableDeviceRescueTest-1639847037-project-member] Lock "3833002b-0acf-4093-8f10-097760487c73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.397s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-bc8f76ce-99a2-4bc0-8ea3-ea1712e2eeb1 req-a09c60e5-be55-48eb-a071-88e51b4e2227 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bc8f76ce-99a2-4bc0-8ea3-ea1712e2eeb1 req-a09c60e5-be55-48eb-a071-88e51b4e2227 service nova] Acquiring lock "3833002b-0acf-4093-8f10-097760487c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bc8f76ce-99a2-4bc0-8ea3-ea1712e2eeb1 req-a09c60e5-be55-48eb-a071-88e51b4e2227 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bc8f76ce-99a2-4bc0-8ea3-ea1712e2eeb1 req-a09c60e5-be55-48eb-a071-88e51b4e2227 service nova] Lock "3833002b-0acf-4093-8f10-097760487c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-bc8f76ce-99a2-4bc0-8ea3-ea1712e2eeb1 req-a09c60e5-be55-48eb-a071-88e51b4e2227 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] No waiting events found dispatching network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:06 user nova-compute[75017]: WARNING nova.compute.manager [req-bc8f76ce-99a2-4bc0-8ea3-ea1712e2eeb1 req-a09c60e5-be55-48eb-a071-88e51b4e2227 service nova] [instance: 3833002b-0acf-4093-8f10-097760487c73] Received unexpected event network-vif-plugged-8a2b14a4-3ecb-4c54-ac67-7917a612e660 for instance with vm_state deleted and task_state None.
Oct 30 09:25:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-92c90ba5-6d90-4c31-8183-9e2342c2f5e7 req-659eeb10-a342-48bf-a975-7aac25e7d88d service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received event network-changed-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-92c90ba5-6d90-4c31-8183-9e2342c2f5e7 req-659eeb10-a342-48bf-a975-7aac25e7d88d service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Refreshing instance network info cache due to event network-changed-9e28ff70-628f-4e32-b24b-19676f74db8e. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:25:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-92c90ba5-6d90-4c31-8183-9e2342c2f5e7 req-659eeb10-a342-48bf-a975-7aac25e7d88d service nova] Acquiring lock "refresh_cache-f574374d-8672-4215-b099-2b663288f6ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:25:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-92c90ba5-6d90-4c31-8183-9e2342c2f5e7 req-659eeb10-a342-48bf-a975-7aac25e7d88d service nova] Acquired lock "refresh_cache-f574374d-8672-4215-b099-2b663288f6ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:25:11 user nova-compute[75017]: DEBUG nova.network.neutron [req-92c90ba5-6d90-4c31-8183-9e2342c2f5e7 req-659eeb10-a342-48bf-a975-7aac25e7d88d service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Refreshing network info cache for port 9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:25:12 user nova-compute[75017]: DEBUG nova.network.neutron [req-92c90ba5-6d90-4c31-8183-9e2342c2f5e7 req-659eeb10-a342-48bf-a975-7aac25e7d88d service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Updated VIF entry in instance network info cache for port 9e28ff70-628f-4e32-b24b-19676f74db8e. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:25:12 user nova-compute[75017]: DEBUG nova.network.neutron [req-92c90ba5-6d90-4c31-8183-9e2342c2f5e7 req-659eeb10-a342-48bf-a975-7aac25e7d88d service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Updating instance_info_cache with network_info: [{"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-92c90ba5-6d90-4c31-8183-9e2342c2f5e7 req-659eeb10-a342-48bf-a975-7aac25e7d88d service nova] Releasing lock "refresh_cache-f574374d-8672-4215-b099-2b663288f6ab" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:25:14 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:25:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:15 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:25:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOWlZmSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:17 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:17 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:17 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bda77e-8d9d-4ff3-8123-dd786c320967]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:25:17 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab36bf1-a57f-4cd7-a056-a732d4d81d47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4] added
Oct 30 09:25:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc81f4b-3dca-4c8d-abbe-3183fe039e89]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae069be5-ce13-4ec5-a3db-a632c5a35a8a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOWlZmSG {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOWlZmSG" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ac0e60-4ad1-4e70-ae42-eac8361e7b77]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zOWlZmSG'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb347ed-5619-485a-bc54-75c66d709301]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3e5b30-acdc-44c0-b4c0-7dc057553964]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c410b24-5744-4835-a52c-355e65733343]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4, portal: 172.16.0.220,3260]
Oct 30 09:25:18 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4, portal: 172.16.0.220,3260] successful.
Oct 30 09:25:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11627ac-aaa7-4f19-90e6-2e82fe270167]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ca2b6d-084d-4d88-9133-fcdf8ec44056]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:18 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce5846e-8648-44f6-b815-f328a575fd5d]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOWlZmSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG nova.objects.instance [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lazy-loading 'flavor' on Instance uuid f574374d-8672-4215-b099-2b663288f6ab {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:18 user nova-compute[75017]: INFO nova.compute.manager [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Attaching volume 1475865e-44ec-4351-9720-982a67618beb to /dev/vdb
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.utils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63372d-1f27-4446-a355-ace9c6c9fc78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7862f4-ccf9-4087-aefc-7e58a1a84e74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd3852-841f-4d4b-b196-c7e3a35322ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[587767b6-4dd6-4f16-99c0-9ae9b789725d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:25:18 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06ebf72-90d3-46c4-acaa-0a74ca6f02d5]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG os_brick.utils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Updating existing volume attachment record: d1dd9413-6c56-42b9-a892-6fe4d4962450 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23564313865306633', 'path': '/dev/sdg'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564313865306633', 'path': '/dev/sdg'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG nova.objects.instance [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lazy-loading 'flavor' on Instance uuid e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:25:19 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:25:19 user nova-compute[75017]:   <source dev="/dev/sdg"/>
Oct 30 09:25:19 user nova-compute[75017]:   <target dev="vdc" bus="virtio"/>
Oct 30 09:25:19 user nova-compute[75017]:   <serial>b756c20f-cd3e-4a6c-ba8a-808fda28b1a4</serial>
Oct 30 09:25:19 user nova-compute[75017]: </disk>
Oct 30 09:25:19 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] No VIF found with MAC fa:16:3e:32:a2:a2, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8dd7428c-d355-4e8e-bb84-ec1cec2d91f4 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.645s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:20 user nova-compute[75017]: INFO nova.compute.manager [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Detaching volume b756c20f-cd3e-4a6c-ba8a-808fda28b1a4
Oct 30 09:25:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:20 user nova-compute[75017]: INFO nova.virt.block_device [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Attempting to driver detach volume b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 from mountpoint /dev/vdc
Oct 30 09:25:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Attempting to detach device vdc from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:25:20 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:25:20 user nova-compute[75017]:   <source dev="/dev/sdg"/>
Oct 30 09:25:20 user nova-compute[75017]:   <target dev="vdc" bus="virtio"/>
Oct 30 09:25:20 user nova-compute[75017]:   <serial>b756c20f-cd3e-4a6c-ba8a-808fda28b1a4</serial>
Oct 30 09:25:20 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 09:25:20 user nova-compute[75017]: </disk>
Oct 30 09:25:20 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:25:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Successfully detached device vdc from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 from the persistent domain config.
Oct 30 09:25:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:25:20 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:25:20 user nova-compute[75017]:   <source dev="/dev/sdg"/>
Oct 30 09:25:20 user nova-compute[75017]:   <target dev="vdc" bus="virtio"/>
Oct 30 09:25:20 user nova-compute[75017]:   <serial>b756c20f-cd3e-4a6c-ba8a-808fda28b1a4</serial>
Oct 30 09:25:20 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 09:25:20 user nova-compute[75017]: </disk>
Oct 30 09:25:20 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-f9bd5049-2038-41ab-9bb5-1778887aab28 req-a4e90380-8885-4dac-8865-0a0c5c28b97a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-changed-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-f9bd5049-2038-41ab-9bb5-1778887aab28 req-a4e90380-8885-4dac-8865-0a0c5c28b97a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing instance network info cache due to event network-changed-8902fbc7-3cb8-4930-b993-59b616561923. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f9bd5049-2038-41ab-9bb5-1778887aab28 req-a4e90380-8885-4dac-8865-0a0c5c28b97a service nova] Acquiring lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f9bd5049-2038-41ab-9bb5-1778887aab28 req-a4e90380-8885-4dac-8865-0a0c5c28b97a service nova] Acquired lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG nova.network.neutron [req-f9bd5049-2038-41ab-9bb5-1778887aab28 req-a4e90380-8885-4dac-8865-0a0c5c28b97a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Refreshing network info cache for port 8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:22 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:25:22 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=6950MB free_disk=25.208419799804688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Applying migration context for instance 28c7433c-4edd-4d5b-8d9c-68308998a508 as it has an incoming, in-progress migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822. Migration status is finished {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 30 09:25:22 user nova-compute[75017]: INFO nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating resource usage from migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e44fccb6-efe6-461a-91d0-bf1628183258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f574374d-8672-4215-b099-2b663288f6ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e2abbf92-799d-4786-92f3-6310abeb534b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1af08de5-92f6-44fc-aa50-0130c5068105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:25:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:25:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-f9bd5049-2038-41ab-9bb5-1778887aab28 req-a4e90380-8885-4dac-8865-0a0c5c28b97a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updated VIF entry in instance network info cache for port 8902fbc7-3cb8-4930-b993-59b616561923. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:25:23 user nova-compute[75017]: DEBUG nova.network.neutron [req-f9bd5049-2038-41ab-9bb5-1778887aab28 req-a4e90380-8885-4dac-8865-0a0c5c28b97a service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f9bd5049-2038-41ab-9bb5-1778887aab28 req-a4e90380-8885-4dac-8865-0a0c5c28b97a service nova] Releasing lock "refresh_cache-cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:25:23 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:25:23 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:25:23 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:25:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.686s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid 35e56f63-7e8b-4324-b16c-b4fac5bb0087 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:24 user nova-compute[75017]: INFO nova.compute.manager [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Terminating instance
Oct 30 09:25:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-f142640d-b525-4a53-aa67-88f37078e6f3 req-f17db4b7-6da4-4503-8f4b-0aaac9a9d1ff service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f142640d-b525-4a53-aa67-88f37078e6f3 req-f17db4b7-6da4-4503-8f4b-0aaac9a9d1ff service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f142640d-b525-4a53-aa67-88f37078e6f3 req-f17db4b7-6da4-4503-8f4b-0aaac9a9d1ff service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f142640d-b525-4a53-aa67-88f37078e6f3 req-f17db4b7-6da4-4503-8f4b-0aaac9a9d1ff service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-f142640d-b525-4a53-aa67-88f37078e6f3 req-f17db4b7-6da4-4503-8f4b-0aaac9a9d1ff service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-unplugged-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-f142640d-b525-4a53-aa67-88f37078e6f3 req-f17db4b7-6da4-4503-8f4b-0aaac9a9d1ff service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-8902fbc7-3cb8-4930-b993-59b616561923 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updating instance_info_cache with network_info: [{"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-35e56f63-7e8b-4324-b16c-b4fac5bb0087" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-331470d9-c2db-4618-a883-2585fc8c0856 req-aefd90dc-24c8-4ee8-a2f7-3678f38e8226 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-331470d9-c2db-4618-a883-2585fc8c0856 req-aefd90dc-24c8-4ee8-a2f7-3678f38e8226 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-331470d9-c2db-4618-a883-2585fc8c0856 req-aefd90dc-24c8-4ee8-a2f7-3678f38e8226 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-331470d9-c2db-4618-a883-2585fc8c0856 req-aefd90dc-24c8-4ee8-a2f7-3678f38e8226 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-331470d9-c2db-4618-a883-2585fc8c0856 req-aefd90dc-24c8-4ee8-a2f7-3678f38e8226 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-unplugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-331470d9-c2db-4618-a883-2585fc8c0856 req-aefd90dc-24c8-4ee8-a2f7-3678f38e8226 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Instance destroyed successfully.
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lazy-loading 'resources' on Instance uuid cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:52:11,bridge_name='br-int',has_traffic_filtering=True,id=8902fbc7-3cb8-4930-b993-59b616561923,network=Network(460976ff-5485-4f00-a723-c725a35d1a35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8902fbc7-3c') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:52:11,bridge_name='br-int',has_traffic_filtering=True,id=8902fbc7-3cb8-4930-b993-59b616561923,network=Network(460976ff-5485-4f00-a723-c725a35d1a35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8902fbc7-3c') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8902fbc7-3c, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51bdd33f-1459-4fd0-8465-4f1cb11fa684) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: INFO os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:52:11,bridge_name='br-int',has_traffic_filtering=True,id=8902fbc7-3cb8-4930-b993-59b616561923,network=Network(460976ff-5485-4f00-a723-c725a35d1a35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8902fbc7-3c')
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:54:2e,bridge_name='br-int',has_traffic_filtering=True,id=3227e083-e191-4e71-8cf9-ee47e00baa27,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3227e083-e1') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:54:2e,bridge_name='br-int',has_traffic_filtering=True,id=3227e083-e191-4e71-8cf9-ee47e00baa27,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3227e083-e1') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3227e083-e1, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6adb8d61-e0b3-47aa-b738-d63071289cca) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: INFO os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:54:2e,bridge_name='br-int',has_traffic_filtering=True,id=3227e083-e191-4e71-8cf9-ee47e00baa27,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3227e083-e1')
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:60:3c,bridge_name='br-int',has_traffic_filtering=True,id=c9d65d25-f069-45d7-b8ec-a6864d8baa6a,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d65d25-f0') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:60:3c,bridge_name='br-int',has_traffic_filtering=True,id=c9d65d25-f069-45d7-b8ec-a6864d8baa6a,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d65d25-f0') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9d65d25-f0, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9709e0a-83ae-4d88-8e12-99cb0006c789) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: INFO os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:60:3c,bridge_name='br-int',has_traffic_filtering=True,id=c9d65d25-f069-45d7-b8ec-a6864d8baa6a,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d65d25-f0')
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:de:11,bridge_name='br-int',has_traffic_filtering=True,id=a7cdb9d1-40de-4831-a41e-71aac9bab889,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7cdb9d1-40') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:de:11,bridge_name='br-int',has_traffic_filtering=True,id=a7cdb9d1-40de-4831-a41e-71aac9bab889,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7cdb9d1-40') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7cdb9d1-40, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=705559da-ad94-4e4c-9434-fc9aed89747b) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: INFO os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:de:11,bridge_name='br-int',has_traffic_filtering=True,id=a7cdb9d1-40de-4831-a41e-71aac9bab889,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7cdb9d1-40')
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "f5770317-85f6-49fb-be52-2d309dded989", "address": "fa:16:3e:66:1c:c9", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5770317-85", "ovs_interfaceid": "f5770317-85f6-49fb-be52-2d309dded989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1c:c9,bridge_name='br-int',has_traffic_filtering=True,id=f5770317-85f6-49fb-be52-2d309dded989,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5770317-85') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1c:c9,bridge_name='br-int',has_traffic_filtering=True,id=f5770317-85f6-49fb-be52-2d309dded989,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5770317-85') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5770317-85, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec89a732-0d92-4dce-9e3a-c09eb828b8d8) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: INFO os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1c:c9,bridge_name='br-int',has_traffic_filtering=True,id=f5770317-85f6-49fb-be52-2d309dded989,network=Network(dbd65341-c19b-473a-8aeb-fcbb34924024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5770317-85')
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:95:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd28a095-6324-4d1d-9934-77668c1910f6,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd28a095-63') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:95:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd28a095-6324-4d1d-9934-77668c1910f6,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd28a095-63') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd28a095-63, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55c13e2f-8c8d-4052-92b2-d15c0e987251) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: INFO os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:95:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd28a095-6324-4d1d-9934-77668c1910f6,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd28a095-63')
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T09:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1440365771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1440365771',id=25,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVaYKF37mDBQr/gSLb1KmFH5MN3JV/jOQyKYREtlsqkkCs2DfLnA5JlzxREeDb/bDlmHLIIpsVzOwG8dqWQfmZe3EknHnIko1G4Q+XLpwD2l0Y3NclTlJwcB4QSqZC9jg==',key_name='tempest-keypair-1799022473',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61dff8a2a0b9454090a0e2dbe4ff7bca',ramdisk_id='',reservation_id='r-yoql6cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-345861076',owner_user_name='tempest-TaggedBootDevicesTest-345861076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2586133b11d0454387d886a6d4515411',uuid=cb56b67f-fe13-48dd-8217-e5a5c84aa9a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converting VIF {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=4f505a50-b2ca-4f5f-b06e-9fd1a6646642,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f505a50-b2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=4f505a50-b2ca-4f5f-b06e-9fd1a6646642,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f505a50-b2') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f505a50-b2, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4bded0d-cd67-4297-b396-7f18aedbf86b) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:26 user nova-compute[75017]: INFO os_vif [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=4f505a50-b2ca-4f5f-b06e-9fd1a6646642,network=Network(0b07f5ed-af90-41cb-a9f1-f526ae610a1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f505a50-b2')
Oct 30 09:25:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIVenNjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:26 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[74212e11-c752-4e38-b8aa-aa212a6c35a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:25:27 user nova-compute[75017]: No targets found.
Oct 30 09:25:27 user nova-compute[75017]: iSNS:
Oct 30 09:25:27 user nova-compute[75017]: No targets found.
Oct 30 09:25:27 user nova-compute[75017]: STATIC:
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: FIRMWARE:
Oct 30 09:25:27 user nova-compute[75017]: No targets found.
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:25:27 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:25:27 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2a9129-f348-4a6b-83bf-5b8317d51d28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d15177-452f-4a10-9f0a-f49c49153954]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf04d3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:27 user nova-compute[75017]: WARNING nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-8902fbc7-3cb8-4930-b993-59b616561923 for instance with vm_state active and task_state deleting.
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-unplugged-3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-3227e083-e191-4e71-8cf9-ee47e00baa27 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-3227e083-e191-4e71-8cf9-ee47e00baa27 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:27 user nova-compute[75017]: WARNING nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-3227e083-e191-4e71-8cf9-ee47e00baa27 for instance with vm_state active and task_state deleting.
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-unplugged-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-f5770317-85f6-49fb-be52-2d309dded989 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:27 user nova-compute[75017]: WARNING nova.compute.manager [req-d55dad21-45a7-4a36-96aa-dee9e8ccf81e req-adf17557-c8dc-4514-85a4-b88bd2c19f75 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-f5770317-85f6-49fb-be52-2d309dded989 for instance with vm_state active and task_state deleting.
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f94d501-1df5-496d-8935-3d608d4e2ea9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8992b5df-7dbf-45d5-9691-0642edcf28fa]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f975533-7379-43ee-930b-40e5fb55513d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ec1fba-c88e-4743-a6fa-6c01f9d2c018]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23cd8a-51c0-4b7b-bb56-d808b52f1f7e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[611daa40-973e-41fc-99fa-b130e459984e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b, portal: 172.16.0.220,3260]
Oct 30 09:25:27 user nova-compute[75017]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b, portal: 172.16.0.220,3260] successful.
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e2a69a-e430-4413-866d-fc6e0f3c7d0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa79faa-a0e8-458a-a222-24153c3dd4e5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] <== disconnect_volume: return (352ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrmVUHqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:27 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c13ac06-1da8-4651-8932-8a19c3215816]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:25:27 user nova-compute[75017]: No targets found.
Oct 30 09:25:27 user nova-compute[75017]: iSNS:
Oct 30 09:25:27 user nova-compute[75017]: No targets found.
Oct 30 09:25:27 user nova-compute[75017]: STATIC:
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: FIRMWARE:
Oct 30 09:25:27 user nova-compute[75017]: No targets found.
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:25:27 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:25:27 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ad7d96-dccc-4aca-9c6d-36dc333861b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[668ceed4-36ff-4829-bee9-449f1710ffab]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf04d3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f1603a-c0d9-4733-a4d0-854e285d0cbc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cfd76b-4df3-4b6f-a9f9-d55537627678]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc551376-41cd-4d22-990b-34089cba58ac]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bac38fc-2343-4bad-bbb2-851f1a1b5740]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-c679d617-7edb-4682-9bcb-cae8a4257cc1 req-d016bbdc-f07d-42a4-88d6-863575e21d26 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c679d617-7edb-4682-9bcb-cae8a4257cc1 req-d016bbdc-f07d-42a4-88d6-863575e21d26 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c679d617-7edb-4682-9bcb-cae8a4257cc1 req-d016bbdc-f07d-42a4-88d6-863575e21d26 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c679d617-7edb-4682-9bcb-cae8a4257cc1 req-d016bbdc-f07d-42a4-88d6-863575e21d26 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-c679d617-7edb-4682-9bcb-cae8a4257cc1 req-d016bbdc-f07d-42a4-88d6-863575e21d26 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-unplugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-c679d617-7edb-4682-9bcb-cae8a4257cc1 req-d016bbdc-f07d-42a4-88d6-863575e21d26 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[755945ac-968e-457c-993b-0e931124179a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faf409d-7103-4714-b468-cdca825fbf03]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef, portal: 172.16.0.220,3260]
Oct 30 09:25:27 user nova-compute[75017]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef, portal: 172.16.0.220,3260] successful.
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6c45c7-58ce-4b7e-b457-27bcde41fbef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[59197e49-5b27-4879-b633-893d7b5ef742]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] <== disconnect_volume: return (370ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKbaxWXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:27 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f094c2-adc7-499f-a09f-2c020baa8b03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:25:27 user nova-compute[75017]: No targets found.
Oct 30 09:25:27 user nova-compute[75017]: iSNS:
Oct 30 09:25:27 user nova-compute[75017]: No targets found.
Oct 30 09:25:27 user nova-compute[75017]: STATIC:
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4
Oct 30 09:25:27 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:27 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:27 user nova-compute[75017]: FIRMWARE:
Oct 30 09:25:27 user nova-compute[75017]: No targets found.
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:25:27 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:25:27 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2263926-12a5-4ba9-ae1e-629c3b5cdb89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e8a0f6-97b1-44f4-a258-5000bda574ba]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:27 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:27 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf0557eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54'): ({'sdd'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Removing single pathed devices sdd {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5922a9-0697-45b1-8ae9-b5b6222d16f5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d3e10-ff26-46cb-8a5e-ac5fe9295740]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Flushing IO for device /dev/sdd {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c749ea6b-188b-4054-ad3a-9b1dc6916525]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2265e9c-f9db-4067-af20-f2136777074e]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a7a2d-9f39-4292-9da9-ac9c228dfa21]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-cfa730e8-cee6-418e-9dd8-6b980b2add1a req-1b200b50-978c-4c12-8290-c9abc10a0206 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cfa730e8-cee6-418e-9dd8-6b980b2add1a req-1b200b50-978c-4c12-8290-c9abc10a0206 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cfa730e8-cee6-418e-9dd8-6b980b2add1a req-1b200b50-978c-4c12-8290-c9abc10a0206 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cfa730e8-cee6-418e-9dd8-6b980b2add1a req-1b200b50-978c-4c12-8290-c9abc10a0206 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:27 user nova-compute[75017]: DEBUG nova.compute.manager [req-cfa730e8-cee6-418e-9dd8-6b980b2add1a req-1b200b50-978c-4c12-8290-c9abc10a0206 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:27 user nova-compute[75017]: WARNING nova.compute.manager [req-cfa730e8-cee6-418e-9dd8-6b980b2add1a req-1b200b50-978c-4c12-8290-c9abc10a0206 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 for instance with vm_state active and task_state deleting.
Oct 30 09:25:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f04db6d-11c7-4760-84db-0187f2044b20]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54, portal: 172.16.0.220,3260]
Oct 30 09:25:28 user nova-compute[75017]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54, portal: 172.16.0.220,3260] successful.
Oct 30 09:25:28 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2296f3e-226d-4bc7-8fb4-4ea592820a54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb054b-d0a2-4b8e-8e1e-a294cca29c53]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] <== disconnect_volume: return (330ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:25:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Deleting instance files /opt/stack/data/nova/instances/cb56b67f-fe13-48dd-8217-e5a5c84aa9a2_del
Oct 30 09:25:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Deletion of /opt/stack/data/nova/instances/cb56b67f-fe13-48dd-8217-e5a5c84aa9a2_del complete
Oct 30 09:25:28 user nova-compute[75017]: INFO nova.compute.manager [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Took 3.56 seconds to destroy the instance on the hypervisor.
Oct 30 09:25:28 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:25:28 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Port 6eb5467b-29cc-4ead-87d9-46828d9a797b binding to destination host user is already ACTIVE {{(pid=75017) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquired lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:29 user nova-compute[75017]: WARNING nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-c9d65d25-f069-45d7-b8ec-a6864d8baa6a for instance with vm_state active and task_state deleting.
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-unplugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:29 user nova-compute[75017]: WARNING nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-a7cdb9d1-40de-4831-a41e-71aac9bab889 for instance with vm_state active and task_state deleting.
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-unplugged-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-unplugged-fd28a095-6324-4d1d-9934-77668c1910f6 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-plugged-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Acquiring lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] No waiting events found dispatching network-vif-plugged-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:29 user nova-compute[75017]: WARNING nova.compute.manager [req-8ec4ac71-5524-4051-8b54-f2d9a30e1daa req-90f08ab6-2261-46ec-973b-131b9361a9a5 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received unexpected event network-vif-plugged-fd28a095-6324-4d1d-9934-77668c1910f6 for instance with vm_state active and task_state deleting.
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance_info_cache with network_info: [{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Releasing lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-3a81bf55-1c9d-4390-95d7-8a718491417d req-16985e72-311b-4a6d-8003-2285e867d19d service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-deleted-f5770317-85f6-49fb-be52-2d309dded989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:29 user nova-compute[75017]: INFO nova.compute.manager [req-3a81bf55-1c9d-4390-95d7-8a718491417d req-16985e72-311b-4a6d-8003-2285e867d19d service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Neutron deleted interface f5770317-85f6-49fb-be52-2d309dded989; detaching it from the instance and deleting it from the info cache
Oct 30 09:25:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-3a81bf55-1c9d-4390-95d7-8a718491417d req-16985e72-311b-4a6d-8003-2285e867d19d service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "address": "fa:16:3e:37:d7:60", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f505a50-b2", "ovs_interfaceid": "4f505a50-b2ca-4f5f-b06e-9fd1a6646642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Creating tmpfile /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/tmpa8__bn2i to verify with other compute node that the instance is on the same shared storage. {{(pid=75017) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-3a81bf55-1c9d-4390-95d7-8a718491417d req-16985e72-311b-4a6d-8003-2285e867d19d service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Detach interface failed, port_id=f5770317-85f6-49fb-be52-2d309dded989, reason: Instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance destroyed successfully.
Oct 30 09:25:30 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lazy-loading 'resources' on Instance uuid 28c7433c-4edd-4d5b-8d9c-68308998a508 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-605656703',display_name='tempest-ServerActionsTestOtherB-server-605656703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-605656703',id=19,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsO3D8imqXadqbsvenS1ZFOBMwiMnHotDuidmowiAb2AKB1yeka44kaMsm8Bk0/3S4Tx29wUyIzxAdVbBUzhcdNcjZWvbYuXl0341auprHHVWRadGKrbSxoWPFvfh13Q==',key_name='tempest-keypair-1868016218',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b631fb81c2fc4dc1a7ab30957279de25',ramdisk_id='',reservation_id='r-edgijgvg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-794901056',owner_user_name='tempest-ServerActionsTestOtherB-794901056-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32be8c463bb84c4baa5c8af3900ac613',uuid=28c7433c-4edd-4d5b-8d9c-68308998a508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converting VIF {"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG os_vif [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eb5467b-29, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d858bde-4111-4114-9248-0495e5d479e1) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:31 user nova-compute[75017]: INFO os_vif [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29')
Oct 30 09:25:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:31 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32149b-b4bd-43bd-bb7c-8458a405dc04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:25:31 user nova-compute[75017]: No targets found.
Oct 30 09:25:31 user nova-compute[75017]: iSNS:
Oct 30 09:25:31 user nova-compute[75017]: No targets found.
Oct 30 09:25:31 user nova-compute[75017]: STATIC:
Oct 30 09:25:31 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a
Oct 30 09:25:31 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:31 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:31 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:25:31 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:31 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:31 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4
Oct 30 09:25:31 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:31 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:31 user nova-compute[75017]: FIRMWARE:
Oct 30 09:25:31 user nova-compute[75017]: No targets found.
Oct 30 09:25:31 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:25:31 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:25:31 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a82d3e0-496b-428f-b758-2cd95cb90e40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1223f9-6b44-4f6a-bcb2-ec92fefbbf38]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:31 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:31 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:31 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:31 user nova-compute[75017]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:31 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:31 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d14269ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d'): ({'sdf'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Removing single pathed devices sdf {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a4d030-18b3-4f7f-8cce-cede6e2ff41a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abb7bbf-2c65-4afa-8ae0-4486305decbe]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Flushing IO for device /dev/sdf {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5db2771-43c5-4009-879e-670283d13cf3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb097e-1b7d-42a8-a124-2b602c29d220]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] SCSI volumes sdf have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[533528fa-7227-4f8c-8603-4aa24540a22d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[716561ae-2118-41bd-adc0-36bbe00498d7]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]
Oct 30 09:25:31 user nova-compute[75017]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.
Oct 30 09:25:31 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c205fd8e-6589-46d5-823c-6999a6a3acc0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] <== disconnect_volume: return (322ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-deleted-4f505a50-b2ca-4f5f-b06e-9fd1a6646642 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:32 user nova-compute[75017]: INFO nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Neutron deleted interface 4f505a50-b2ca-4f5f-b06e-9fd1a6646642; detaching it from the instance and deleting it from the info cache
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "address": "fa:16:3e:25:de:11", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7cdb9d1-40", "ovs_interfaceid": "a7cdb9d1-40de-4831-a41e-71aac9bab889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Detach interface failed, port_id=4f505a50-b2ca-4f5f-b06e-9fd1a6646642, reason: Instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:32 user nova-compute[75017]: WARNING nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state resized and task_state resize_reverting.
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:32 user nova-compute[75017]: WARNING nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state resized and task_state resize_reverting.
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-deleted-a7cdb9d1-40de-4831-a41e-71aac9bab889 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:32 user nova-compute[75017]: INFO nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Neutron deleted interface a7cdb9d1-40de-4831-a41e-71aac9bab889; detaching it from the instance and deleting it from the info cache
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd28a095-6324-4d1d-9934-77668c1910f6", "address": "fa:16:3e:50:95:7f", "network": {"id": "0b07f5ed-af90-41cb-a9f1-f526ae610a1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-824697986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd28a095-63", "ovs_interfaceid": "fd28a095-6324-4d1d-9934-77668c1910f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Detach interface failed, port_id=a7cdb9d1-40de-4831-a41e-71aac9bab889, reason: Instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-deleted-fd28a095-6324-4d1d-9934-77668c1910f6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:32 user nova-compute[75017]: INFO nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Neutron deleted interface fd28a095-6324-4d1d-9934-77668c1910f6; detaching it from the instance and deleting it from the info cache
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [{"id": "8902fbc7-3cb8-4930-b993-59b616561923", "address": "fa:16:3e:f6:52:11", "network": {"id": "460976ff-5485-4f00-a723-c725a35d1a35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2123278933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8902fbc7-3c", "ovs_interfaceid": "8902fbc7-3cb8-4930-b993-59b616561923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:32 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Took 4.08 seconds to deallocate network for instance.
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-29d56c96-03e1-4a96-9248-6e456f9b7564 req-aeae521f-1825-4d02-8984-53bc6a4fd440 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Detach interface failed, port_id=fd28a095-6324-4d1d-9934-77668c1910f6, reason: Instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lazy-loading 'migration_context' on Instance uuid 28c7433c-4edd-4d5b-8d9c-68308998a508 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.objects.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Object Instance<28c7433c-4edd-4d5b-8d9c-68308998a508> lazy-loaded attributes: resources,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:25:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.492s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:33 user nova-compute[75017]: INFO nova.compute.manager [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Swapping old allocation on dict_keys(['f288afb1-3149-4266-a22d-d1442c72ffe3']) held by migration 20ad9e09-cfe5-4e53-85e7-54419d1a8822 for instance
Oct 30 09:25:33 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Overwriting current allocation {'allocations': {'f288afb1-3149-4266-a22d-d1442c72ffe3': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 35}}, 'project_id': 'b631fb81c2fc4dc1a7ab30957279de25', 'user_id': '32be8c463bb84c4baa5c8af3900ac613', 'consumer_generation': 1} on consumer 28c7433c-4edd-4d5b-8d9c-68308998a508 {{(pid=75017) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 30 09:25:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:25:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquired lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:25:33 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-c10bf1bf-0247-4a02-a72a-d6dd949ee331 req-62adf4ec-a7c9-4a5c-afad-be48bda307d1 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Received event network-vif-deleted-8902fbc7-3cb8-4930-b993-59b616561923 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:34 user nova-compute[75017]: INFO nova.compute.manager [req-c10bf1bf-0247-4a02-a72a-d6dd949ee331 req-62adf4ec-a7c9-4a5c-afad-be48bda307d1 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Neutron deleted interface 8902fbc7-3cb8-4930-b993-59b616561923; detaching it from the instance and deleting it from the info cache
Oct 30 09:25:34 user nova-compute[75017]: DEBUG nova.network.neutron [req-c10bf1bf-0247-4a02-a72a-d6dd949ee331 req-62adf4ec-a7c9-4a5c-afad-be48bda307d1 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Updating instance_info_cache with network_info: [{"id": "3227e083-e191-4e71-8cf9-ee47e00baa27", "address": "fa:16:3e:a8:54:2e", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3227e083-e1", "ovs_interfaceid": "3227e083-e191-4e71-8cf9-ee47e00baa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "address": "fa:16:3e:ff:60:3c", "network": {"id": "dbd65341-c19b-473a-8aeb-fcbb34924024", "bridge": "br-int", "label": "tempest-device-tagging-net1-1209846979", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61dff8a2a0b9454090a0e2dbe4ff7bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d65d25-f0", "ovs_interfaceid": "c9d65d25-f069-45d7-b8ec-a6864d8baa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-c10bf1bf-0247-4a02-a72a-d6dd949ee331 req-62adf4ec-a7c9-4a5c-afad-be48bda307d1 service nova] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Detach interface failed, port_id=8902fbc7-3cb8-4930-b993-59b616561923, reason: Instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance_info_cache with network_info: [{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Releasing lock "refresh_cache-28c7433c-4edd-4d5b-8d9c-68308998a508" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG os_brick.utils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e0f2b-45a1-4110-bf42-97b078f03600]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4f9e71-222b-42f0-a647-058d33b55f8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee1992b-4ddb-4d23-acc4-4f2821a07b98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2029e2d6-a095-4143-b0d4-24d81bf4f591]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:25:34 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:25:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce42e1e-74f1-4920-8c0a-83319c8b1cdb]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:25:34 user nova-compute[75017]: DEBUG os_brick.utils [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:35 user nova-compute[75017]: INFO nova.compute.manager [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] [instance: cb56b67f-fe13-48dd-8217-e5a5c84aa9a2] Took 2.89 seconds to detach 3 volumes for instance.
Oct 30 09:25:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:35 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:25:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:25:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:35 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Deleted allocations for instance cb56b67f-fe13-48dd-8217-e5a5c84aa9a2
Oct 30 09:25:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3e4af74-67c5-4dbd-aa98-9bb73a1e1532 tempest-TaggedBootDevicesTest-345861076 tempest-TaggedBootDevicesTest-345861076-project-member] Lock "cb56b67f-fe13-48dd-8217-e5a5c84aa9a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.193s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:25:40 user nova-compute[75017]: INFO nova.compute.claims [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Claim successful on node user
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:25:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.policy [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ab92f42f38f4dbf8826cae09de164dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084ddae4af6448ca2f5b36497ab3a2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:25:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Creating image(s)
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "/opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "/opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "d4a769a7722947c845d1338b7e0411eb8c3e4bf5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "d4a769a7722947c845d1338b7e0411eb8c3e4bf5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 is timed out.
Oct 30 09:25:41 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Successfully detached device vdc from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 from the live domain config.
Oct 30 09:25:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOWlZmSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:41 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb03a518-4595-4eff-8390-42552f32751e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:25:41 user nova-compute[75017]: No targets found.
Oct 30 09:25:41 user nova-compute[75017]: iSNS:
Oct 30 09:25:41 user nova-compute[75017]: No targets found.
Oct 30 09:25:41 user nova-compute[75017]: STATIC:
Oct 30 09:25:41 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a
Oct 30 09:25:41 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:41 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:41 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4
Oct 30 09:25:41 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:25:41 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:25:41 user nova-compute[75017]: FIRMWARE:
Oct 30 09:25:41 user nova-compute[75017]: No targets found.
Oct 30 09:25:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:25:41 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:25:41 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f0a73a-4f38-470b-8bb5-76270c89ea98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc54d64-3e16-4e96-912b-83d5201e48fe]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:41 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:41 user nova-compute[75017]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 (non-flash)
Oct 30 09:25:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccb0ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4'): ({'sdg'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Removing single pathed devices sdg {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6859ef-16f7-4e7f-9de4-080305045869]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[422ffc90-2414-46a4-9ee8-e7f8f8d985d8]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Flushing IO for device /dev/sdg {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5.part --force-share --output=json" returned: 0 in 0.217s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG nova.virt.images [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] 8de72756-a61b-4f24-9830-5cdc0232d561 was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5.part /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1984b039-4c9f-4e61-8694-616bc28cb3c0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Successfully created port: 49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVfrvSjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:41 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ec3e59-fd0c-4f86-a465-9d004dfa7f23]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] SCSI volumes sdg have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefd83a9-81e6-4c6f-8fd3-abcc5e0e9880]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7e1f25-8969-46c4-b1cf-827c0928e206]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4, portal: 172.16.0.220,3260]
Oct 30 09:25:41 user nova-compute[75017]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4, portal: 172.16.0.220,3260] successful.
Oct 30 09:25:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b756c20f-cd3e-4a6c-ba8a-808fda28b1a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf419d8c-c7ec-437f-8fb3-ab4caa95d2e1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] <== disconnect_volume: return (430ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.170s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:41 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:41 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:25:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[af98289a-e105-4c26-945f-499b5c77f216]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:25:42 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6416852-5346-4ff0-95f7-ae17d4ca3c77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb] added
Oct 30 09:25:42 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5.part /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5.converted" returned: 0 in 0.342s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[600ca3b3-be73-4576-95ac-28386540c653]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1ec248-7614-468f-8d2d-52f08b16013a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVfrvSjY {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVfrvSjY" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e63862-77ad-4b70-a409-ac13900a27c7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WVfrvSjY'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2e18b8-5011-4989-af84-7a3cb0389b37]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c040924-ae85-4796-b5d2-f9d424ba46c2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:42 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:42 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "d4a769a7722947c845d1338b7e0411eb8c3e4bf5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.266s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47fe6fb-4261-4061-aa16-4b1fc379dbaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb, portal: 172.16.0.220,3260]
Oct 30 09:25:42 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb, portal: 172.16.0.220,3260] successful.
Oct 30 09:25:42 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e652ed77-d0bd-40fd-ae38-4273c0252737]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a4fd5a-e14d-488a-a781-5adf0f7a4f82]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:42 user nova-compute[75017]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)
Oct 30 09:25:42 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:42 user nova-compute[75017]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)
Oct 30 09:25:42 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71a4151-c92c-4465-834e-50b1ceff0bdc]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVfrvSjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5 --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "d4a769a7722947c845d1338b7e0411eb8c3e4bf5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "d4a769a7722947c845d1338b7e0411eb8c3e4bf5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5 --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5,backing_fmt=raw /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Successfully updated port: 49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5,backing_fmt=raw /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk 1073741824" returned: 0 in 0.053s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "d4a769a7722947c845d1338b7e0411eb8c3e4bf5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-6440193c-962a-4115-9580-e5ffb8e641d4 req-8f30c527-2e69-4f88-b876-d943e8c954d0 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-6440193c-962a-4115-9580-e5ffb8e641d4 req-8f30c527-2e69-4f88-b876-d943e8c954d0 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing instance network info cache due to event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6440193c-962a-4115-9580-e5ffb8e641d4 req-8f30c527-2e69-4f88-b876-d943e8c954d0 service nova] Acquiring lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6440193c-962a-4115-9580-e5ffb8e641d4 req-8f30c527-2e69-4f88-b876-d943e8c954d0 service nova] Acquired lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG nova.network.neutron [req-6440193c-962a-4115-9580-e5ffb8e641d4 req-8f30c527-2e69-4f88-b876-d943e8c954d0 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing network info cache for port 49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5 --force-share --output=json" returned: 0 in 0.191s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG nova.network.neutron [req-6440193c-962a-4115-9580-e5ffb8e641d4 req-8f30c527-2e69-4f88-b876-d943e8c954d0 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:25:42 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lazy-loading 'flavor' on Instance uuid e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9bc9d39-d24b-423c-804c-d8b759c7c00d tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.226s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Cannot resize image /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Ensure instance console log exists: /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.network.neutron [req-6440193c-962a-4115-9580-e5ffb8e641d4 req-8f30c527-2e69-4f88-b876-d943e8c954d0 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6440193c-962a-4115-9580-e5ffb8e641d4 req-8f30c527-2e69-4f88-b876-d943e8c954d0 service nova] Releasing lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquired lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] <== connect_volume: return (1604ms) {'type': 'block', 'scsi_wwn': '23566326662383365', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566326662383365', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.objects.instance [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lazy-loading 'flavor' on Instance uuid f574374d-8672-4215-b099-2b663288f6ab {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:25:43 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:25:43 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:25:43 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:25:43 user nova-compute[75017]:   <serial>1475865e-44ec-4351-9720-982a67618beb</serial>
Oct 30 09:25:43 user nova-compute[75017]: </disk>
Oct 30 09:25:43 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating instance_info_cache with network_info: [{"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Releasing lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Instance network_info: |[{"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Start _get_guest_xml network_info=[{"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:25:37Z,direct_url=<?>,disk_format='qcow2',id=8de72756-a61b-4f24-9830-5cdc0232d561,min_disk=0,min_ram=0,name='tempest-scenario-img--331308966',owner='c084ddae4af6448ca2f5b36497ab3a2b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:25:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': '8de72756-a61b-4f24-9830-5cdc0232d561'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:25:43 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:25:43 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:25:37Z,direct_url=<?>,disk_format='qcow2',id=8de72756-a61b-4f24-9830-5cdc0232d561,min_disk=0,min_ram=0,name='tempest-scenario-img--331308966',owner='c084ddae4af6448ca2f5b36497ab3a2b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:25:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-918079801',display_name='tempest-TestMinimumBasicScenario-server-918079801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-918079801',id=32,image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE24YPg1Ak5sM6DkthwvfZ+/kcYISGoukw1d/2DOcyquVhL+FuJ9OD3LUTJC+QkpUhxic54/g418MtXzzVYvmIamLZrJKXOBTFTJX7khlZcm9GsTu2EiTOYSmU7K2LDA9A==',key_name='tempest-TestMinimumBasicScenario-915519336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c084ddae4af6448ca2f5b36497ab3a2b',ramdisk_id='',reservation_id='r-0jq7ye0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-692819593',owner_user_name='tempest-TestMinimumBasicScenario-692819593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:25:41Z,user_data=None,user_id='2ab92f42f38f4dbf8826cae09de164dd',uuid=7f87386d-6a8e-4095-8ef5-405810b32730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converting VIF {"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:25:43 user nova-compute[75017]:   <uuid>7f87386d-6a8e-4095-8ef5-405810b32730</uuid>
Oct 30 09:25:43 user nova-compute[75017]:   <name>instance-00000020</name>
Oct 30 09:25:43 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:25:43 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:25:43 user nova-compute[75017]:   <metadata>
Oct 30 09:25:43 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:25:43 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:25:43 user nova-compute[75017]:       <nova:name>tempest-TestMinimumBasicScenario-server-918079801</nova:name>
Oct 30 09:25:43 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:25:43</nova:creationTime>
Oct 30 09:25:43 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:25:43 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:25:43 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:25:43 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:25:43 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:25:43 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:25:43 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:25:43 user nova-compute[75017]:       <nova:owner>
Oct 30 09:25:43 user nova-compute[75017]:         <nova:user uuid="2ab92f42f38f4dbf8826cae09de164dd">tempest-TestMinimumBasicScenario-692819593-project-member</nova:user>
Oct 30 09:25:43 user nova-compute[75017]:         <nova:project uuid="c084ddae4af6448ca2f5b36497ab3a2b">tempest-TestMinimumBasicScenario-692819593</nova:project>
Oct 30 09:25:43 user nova-compute[75017]:       </nova:owner>
Oct 30 09:25:43 user nova-compute[75017]:       <nova:root type="image" uuid="8de72756-a61b-4f24-9830-5cdc0232d561"/>
Oct 30 09:25:43 user nova-compute[75017]:       <nova:ports>
Oct 30 09:25:43 user nova-compute[75017]:         <nova:port uuid="49a85ae2-be3d-4bc7-a478-1e496239897b">
Oct 30 09:25:43 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 09:25:43 user nova-compute[75017]:         </nova:port>
Oct 30 09:25:43 user nova-compute[75017]:       </nova:ports>
Oct 30 09:25:43 user nova-compute[75017]:     </nova:instance>
Oct 30 09:25:43 user nova-compute[75017]:   </metadata>
Oct 30 09:25:43 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:25:43 user nova-compute[75017]:     <system>
Oct 30 09:25:43 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:25:43 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:25:43 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:25:43 user nova-compute[75017]:       <entry name="serial">7f87386d-6a8e-4095-8ef5-405810b32730</entry>
Oct 30 09:25:43 user nova-compute[75017]:       <entry name="uuid">7f87386d-6a8e-4095-8ef5-405810b32730</entry>
Oct 30 09:25:43 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:25:43 user nova-compute[75017]:     </system>
Oct 30 09:25:43 user nova-compute[75017]:   </sysinfo>
Oct 30 09:25:43 user nova-compute[75017]:   <os>
Oct 30 09:25:43 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:25:43 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:25:43 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:25:43 user nova-compute[75017]:   </os>
Oct 30 09:25:43 user nova-compute[75017]:   <features>
Oct 30 09:25:43 user nova-compute[75017]:     <acpi/>
Oct 30 09:25:43 user nova-compute[75017]:     <apic/>
Oct 30 09:25:43 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:25:43 user nova-compute[75017]:   </features>
Oct 30 09:25:43 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:25:43 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:25:43 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:25:43 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:25:43 user nova-compute[75017]:   </clock>
Oct 30 09:25:43 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:25:43 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:25:43 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:25:43 user nova-compute[75017]:   </cpu>
Oct 30 09:25:43 user nova-compute[75017]:   <devices>
Oct 30 09:25:43 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:25:43 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:25:43 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk"/>
Oct 30 09:25:43 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:25:43 user nova-compute[75017]:     </disk>
Oct 30 09:25:43 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:25:43 user nova-compute[75017]:       <mac address="fa:16:3e:e8:3b:d2"/>
Oct 30 09:25:43 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:25:43 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:25:43 user nova-compute[75017]:       <target dev="tap49a85ae2-be"/>
Oct 30 09:25:43 user nova-compute[75017]:     </interface>
Oct 30 09:25:43 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:25:43 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/console.log" append="off"/>
Oct 30 09:25:43 user nova-compute[75017]:     </serial>
Oct 30 09:25:43 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:25:43 user nova-compute[75017]:     <video>
Oct 30 09:25:43 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:25:43 user nova-compute[75017]:     </video>
Oct 30 09:25:43 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:25:43 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:25:43 user nova-compute[75017]:     </rng>
Oct 30 09:25:43 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:25:43 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:25:43 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:25:43 user nova-compute[75017]:     </memballoon>
Oct 30 09:25:43 user nova-compute[75017]:   </devices>
Oct 30 09:25:43 user nova-compute[75017]: </domain>
Oct 30 09:25:43 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-918079801',display_name='tempest-TestMinimumBasicScenario-server-918079801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-918079801',id=32,image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE24YPg1Ak5sM6DkthwvfZ+/kcYISGoukw1d/2DOcyquVhL+FuJ9OD3LUTJC+QkpUhxic54/g418MtXzzVYvmIamLZrJKXOBTFTJX7khlZcm9GsTu2EiTOYSmU7K2LDA9A==',key_name='tempest-TestMinimumBasicScenario-915519336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c084ddae4af6448ca2f5b36497ab3a2b',ramdisk_id='',reservation_id='r-0jq7ye0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-692819593',owner_user_name='tempest-TestMinimumBasicScenario-692819593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:25:41Z,user_data=None,user_id='2ab92f42f38f4dbf8826cae09de164dd',uuid=7f87386d-6a8e-4095-8ef5-405810b32730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converting VIF {"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG os_vif [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88ca5e64-59f0-51cb-a410-03ed54cc1fca', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49a85ae2-be, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49a85ae2-be, col_values=(('qos', UUID('904bd484-58ba-4c63-b19a-455f6e18ee27')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49a85ae2-be, col_values=(('external_ids', {'iface-id': '49a85ae2-be3d-4bc7-a478-1e496239897b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:3b:d2', 'vm-uuid': '7f87386d-6a8e-4095-8ef5-405810b32730'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:43 user nova-compute[75017]: INFO os_vif [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be')
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No VIF found with MAC fa:16:3e:e8:3b:d2, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:25:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] No VIF found with MAC fa:16:3e:4d:e5:dc, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:25:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6bb1c566-555c-4931-9ac2-1fdeed6f0e23 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.456s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-03bc8172-626a-409e-830e-c9b70d993004 req-e3c4e2dd-18f9-4644-ab6e-ffaaac440815 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-03bc8172-626a-409e-830e-c9b70d993004 req-e3c4e2dd-18f9-4644-ab6e-ffaaac440815 service nova] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-03bc8172-626a-409e-830e-c9b70d993004 req-e3c4e2dd-18f9-4644-ab6e-ffaaac440815 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-03bc8172-626a-409e-830e-c9b70d993004 req-e3c4e2dd-18f9-4644-ab6e-ffaaac440815 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-03bc8172-626a-409e-830e-c9b70d993004 req-e3c4e2dd-18f9-4644-ab6e-ffaaac440815 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] No waiting events found dispatching network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:45 user nova-compute[75017]: WARNING nova.compute.manager [req-03bc8172-626a-409e-830e-c9b70d993004 req-e3c4e2dd-18f9-4644-ab6e-ffaaac440815 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received unexpected event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b for instance with vm_state building and task_state spawning.
Oct 30 09:25:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:45 user nova-compute[75017]: INFO nova.compute.manager [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Detaching volume 1475865e-44ec-4351-9720-982a67618beb
Oct 30 09:25:45 user nova-compute[75017]: INFO nova.virt.block_device [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Attempting to driver detach volume 1475865e-44ec-4351-9720-982a67618beb from mountpoint /dev/vdb
Oct 30 09:25:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Attempting to detach device vdb from instance f574374d-8672-4215-b099-2b663288f6ab from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:25:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:25:45 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:25:45 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:25:45 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:25:45 user nova-compute[75017]:   <serial>1475865e-44ec-4351-9720-982a67618beb</serial>
Oct 30 09:25:45 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:25:45 user nova-compute[75017]: </disk>
Oct 30 09:25:45 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:25:46 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Successfully detached device vdb from instance f574374d-8672-4215-b099-2b663288f6ab from the persistent domain config.
Oct 30 09:25:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f574374d-8672-4215-b099-2b663288f6ab from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:25:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:25:46 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:25:46 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:25:46 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:25:46 user nova-compute[75017]:   <serial>1475865e-44ec-4351-9720-982a67618beb</serial>
Oct 30 09:25:46 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:25:46 user nova-compute[75017]: </disk>
Oct 30 09:25:46 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:25:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f574374d-8672-4215-b099-2b663288f6ab {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:25:47 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Instance spawned successfully.
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-eeac0517-10f4-443b-8671-b754d785ff37 req-f0991314-d86f-4a03-a360-e506f5a08b2a service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eeac0517-10f4-443b-8671-b754d785ff37 req-f0991314-d86f-4a03-a360-e506f5a08b2a service nova] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eeac0517-10f4-443b-8671-b754d785ff37 req-f0991314-d86f-4a03-a360-e506f5a08b2a service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eeac0517-10f4-443b-8671-b754d785ff37 req-f0991314-d86f-4a03-a360-e506f5a08b2a service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-eeac0517-10f4-443b-8671-b754d785ff37 req-f0991314-d86f-4a03-a360-e506f5a08b2a service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] No waiting events found dispatching network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:47 user nova-compute[75017]: WARNING nova.compute.manager [req-eeac0517-10f4-443b-8671-b754d785ff37 req-f0991314-d86f-4a03-a360-e506f5a08b2a service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received unexpected event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b for instance with vm_state building and task_state spawning.
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:25:47 user nova-compute[75017]: INFO nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Took 6.65 seconds to spawn the instance on the hypervisor.
Oct 30 09:25:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:25:47 user nova-compute[75017]: INFO nova.compute.manager [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Took 7.50 seconds to build instance.
Oct 30 09:25:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b086f1fc-b7fa-49fc-9593-a71758ab34fe tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.606s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Starting finish_revert_migration {{(pid=75017) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Start _get_guest_xml network_info=[{"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '28c7433c-4edd-4d5b-8d9c-68308998a508', 'attached_at': '2023-10-30T09:25:55.000000', 'detached_at': '', 'volume_id': 'ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'serial': 'ce6e7a43-efa8-446e-8f59-1f9116c5664d'}, 'disk_bus': 'virtio', 'attachment_id': '0ab971f2-133e-4ef0-8426-3aff74a9482b', 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:25:55 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:25:55 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28c7433c-4edd-4d5b-8d9c-68308998a508 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:25:55 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:55 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:25:55 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[53215d49-3b22-4417-80ae-3222775757d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:25:55 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a7f6c3-1ae4-489c-b29e-7c51a485b638]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d] added
Oct 30 09:25:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd77cf9a-b98d-4d94-9001-afa5f8e4676b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fa0557-e9a2-4cf7-869b-8abf0049b160]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOurUpga {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOurUpga" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a144060-ce9e-44e4-a555-b3290d78c52a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mOurUpga'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbd5897-4c51-44fd-a2b5-1670c3c3253e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d12adc-cb22-44f4-a2c8-4a99eb185415]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:55 user nova-compute[75017]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)
Oct 30 09:25:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:55 user nova-compute[75017]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)
Oct 30 09:25:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[36733cb3-b415-4fc7-bcbd-7b99a3c4c9a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]
Oct 30 09:25:55 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.
Oct 30 09:25:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca436d21-cd45-423c-a0e8-30f32ed98c2f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e46d26b-6517-4519-bb92-682ef296a982]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:55 user nova-compute[75017]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)
Oct 30 09:25:55 user nova-compute[75017]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:25:55 user nova-compute[75017]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)
Oct 30 09:25:55 user nova-compute[75017]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:25:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe25e18-4f53-4882-a09a-ee668103da96]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:25:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26537613665363633', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537613665363633', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-605656703',display_name='tempest-ServerActionsTestOtherB-server-605656703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-605656703',id=19,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsO3D8imqXadqbsvenS1ZFOBMwiMnHotDuidmowiAb2AKB1yeka44kaMsm8Bk0/3S4Tx29wUyIzxAdVbBUzhcdNcjZWvbYuXl0341auprHHVWRadGKrbSxoWPFvfh13Q==',key_name='tempest-keypair-1868016218',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b631fb81c2fc4dc1a7ab30957279de25',ramdisk_id='',reservation_id='r-edgijgvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-794901056',owner_user_name='tempest-ServerActionsTestOtherB-794901056-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:25:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32be8c463bb84c4baa5c8af3900ac613',uuid=28c7433c-4edd-4d5b-8d9c-68308998a508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converting VIF {"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:25:56 user nova-compute[75017]:   <uuid>28c7433c-4edd-4d5b-8d9c-68308998a508</uuid>
Oct 30 09:25:56 user nova-compute[75017]:   <name>instance-00000013</name>
Oct 30 09:25:56 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:25:56 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:25:56 user nova-compute[75017]:   <metadata>
Oct 30 09:25:56 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:25:56 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:25:56 user nova-compute[75017]:       <nova:name>tempest-ServerActionsTestOtherB-server-605656703</nova:name>
Oct 30 09:25:56 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:25:55</nova:creationTime>
Oct 30 09:25:56 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:25:56 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:25:56 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:25:56 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:25:56 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:25:56 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:25:56 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:25:56 user nova-compute[75017]:       <nova:owner>
Oct 30 09:25:56 user nova-compute[75017]:         <nova:user uuid="32be8c463bb84c4baa5c8af3900ac613">tempest-ServerActionsTestOtherB-794901056-project-member</nova:user>
Oct 30 09:25:56 user nova-compute[75017]:         <nova:project uuid="b631fb81c2fc4dc1a7ab30957279de25">tempest-ServerActionsTestOtherB-794901056</nova:project>
Oct 30 09:25:56 user nova-compute[75017]:       </nova:owner>
Oct 30 09:25:56 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:25:56 user nova-compute[75017]:       <nova:ports>
Oct 30 09:25:56 user nova-compute[75017]:         <nova:port uuid="6eb5467b-29cc-4ead-87d9-46828d9a797b">
Oct 30 09:25:56 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 09:25:56 user nova-compute[75017]:         </nova:port>
Oct 30 09:25:56 user nova-compute[75017]:       </nova:ports>
Oct 30 09:25:56 user nova-compute[75017]:     </nova:instance>
Oct 30 09:25:56 user nova-compute[75017]:   </metadata>
Oct 30 09:25:56 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:25:56 user nova-compute[75017]:     <system>
Oct 30 09:25:56 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:25:56 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:25:56 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:25:56 user nova-compute[75017]:       <entry name="serial">28c7433c-4edd-4d5b-8d9c-68308998a508</entry>
Oct 30 09:25:56 user nova-compute[75017]:       <entry name="uuid">28c7433c-4edd-4d5b-8d9c-68308998a508</entry>
Oct 30 09:25:56 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:25:56 user nova-compute[75017]:     </system>
Oct 30 09:25:56 user nova-compute[75017]:   </sysinfo>
Oct 30 09:25:56 user nova-compute[75017]:   <os>
Oct 30 09:25:56 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:25:56 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:25:56 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:25:56 user nova-compute[75017]:   </os>
Oct 30 09:25:56 user nova-compute[75017]:   <features>
Oct 30 09:25:56 user nova-compute[75017]:     <acpi/>
Oct 30 09:25:56 user nova-compute[75017]:     <apic/>
Oct 30 09:25:56 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:25:56 user nova-compute[75017]:   </features>
Oct 30 09:25:56 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:25:56 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:25:56 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:25:56 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:25:56 user nova-compute[75017]:   </clock>
Oct 30 09:25:56 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:25:56 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:25:56 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:25:56 user nova-compute[75017]:   </cpu>
Oct 30 09:25:56 user nova-compute[75017]:   <devices>
Oct 30 09:25:56 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:25:56 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:25:56 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk"/>
Oct 30 09:25:56 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:25:56 user nova-compute[75017]:     </disk>
Oct 30 09:25:56 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:25:56 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:25:56 user nova-compute[75017]:       <source dev="/dev/sdc"/>
Oct 30 09:25:56 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:25:56 user nova-compute[75017]:       <serial>ce6e7a43-efa8-446e-8f59-1f9116c5664d</serial>
Oct 30 09:25:56 user nova-compute[75017]:     </disk>
Oct 30 09:25:56 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:25:56 user nova-compute[75017]:       <mac address="fa:16:3e:7b:86:de"/>
Oct 30 09:25:56 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:25:56 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:25:56 user nova-compute[75017]:       <target dev="tap6eb5467b-29"/>
Oct 30 09:25:56 user nova-compute[75017]:     </interface>
Oct 30 09:25:56 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:25:56 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/console.log" append="off"/>
Oct 30 09:25:56 user nova-compute[75017]:     </serial>
Oct 30 09:25:56 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:25:56 user nova-compute[75017]:     <video>
Oct 30 09:25:56 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:25:56 user nova-compute[75017]:     </video>
Oct 30 09:25:56 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:25:56 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:25:56 user nova-compute[75017]:     </rng>
Oct 30 09:25:56 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:25:56 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:25:56 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:25:56 user nova-compute[75017]:     </memballoon>
Oct 30 09:25:56 user nova-compute[75017]:   </devices>
Oct 30 09:25:56 user nova-compute[75017]: </domain>
Oct 30 09:25:56 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-605656703',display_name='tempest-ServerActionsTestOtherB-server-605656703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-605656703',id=19,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsO3D8imqXadqbsvenS1ZFOBMwiMnHotDuidmowiAb2AKB1yeka44kaMsm8Bk0/3S4Tx29wUyIzxAdVbBUzhcdNcjZWvbYuXl0341auprHHVWRadGKrbSxoWPFvfh13Q==',key_name='tempest-keypair-1868016218',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b631fb81c2fc4dc1a7ab30957279de25',ramdisk_id='',reservation_id='r-edgijgvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-794901056',owner_user_name='tempest-ServerActionsTestOtherB-794901056-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:25:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32be8c463bb84c4baa5c8af3900ac613',uuid=28c7433c-4edd-4d5b-8d9c-68308998a508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converting VIF {"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG os_vif [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ed303ac-fc9f-58b9-b08c-23d5f1157205', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eb5467b-29, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6eb5467b-29, col_values=(('qos', UUID('a151e2d0-d5b9-4940-8bd0-92965ddac19e')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6eb5467b-29, col_values=(('external_ids', {'iface-id': '6eb5467b-29cc-4ead-87d9-46828d9a797b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:86:de', 'vm-uuid': '28c7433c-4edd-4d5b-8d9c-68308998a508'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:25:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:56 user nova-compute[75017]: INFO os_vif [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29')
Oct 30 09:25:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-fedb8d63-df67-4c25-b9b9-a7e8b2f35313 req-00adf2f9-dcdd-41c3-90a7-c1da22e90953 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:25:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fedb8d63-df67-4c25-b9b9-a7e8b2f35313 req-00adf2f9-dcdd-41c3-90a7-c1da22e90953 service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:25:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fedb8d63-df67-4c25-b9b9-a7e8b2f35313 req-00adf2f9-dcdd-41c3-90a7-c1da22e90953 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:25:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fedb8d63-df67-4c25-b9b9-a7e8b2f35313 req-00adf2f9-dcdd-41c3-90a7-c1da22e90953 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:25:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-fedb8d63-df67-4c25-b9b9-a7e8b2f35313 req-00adf2f9-dcdd-41c3-90a7-c1da22e90953 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:25:58 user nova-compute[75017]: WARNING nova.compute.manager [req-fedb8d63-df67-4c25-b9b9-a7e8b2f35313 req-00adf2f9-dcdd-41c3-90a7-c1da22e90953 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state resized and task_state resize_reverting.
Oct 30 09:25:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:25:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:26:00 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance running successfully.
Oct 30 09:26:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] finish_revert_migration finished successfully. {{(pid=75017) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 30 09:26:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-4f5194ca-49cc-4482-8c7a-1d8593fe9002 req-5d0a244f-e1c8-4e7f-975e-fb223d19c0f3 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4f5194ca-49cc-4482-8c7a-1d8593fe9002 req-5d0a244f-e1c8-4e7f-975e-fb223d19c0f3 service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4f5194ca-49cc-4482-8c7a-1d8593fe9002 req-5d0a244f-e1c8-4e7f-975e-fb223d19c0f3 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4f5194ca-49cc-4482-8c7a-1d8593fe9002 req-5d0a244f-e1c8-4e7f-975e-fb223d19c0f3 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-4f5194ca-49cc-4482-8c7a-1d8593fe9002 req-5d0a244f-e1c8-4e7f-975e-fb223d19c0f3 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:26:00 user nova-compute[75017]: WARNING nova.compute.manager [req-4f5194ca-49cc-4482-8c7a-1d8593fe9002 req-5d0a244f-e1c8-4e7f-975e-fb223d19c0f3 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state resized and task_state resize_reverting.
Oct 30 09:26:00 user nova-compute[75017]: INFO nova.compute.manager [None req-b4138d17-ac72-4a67-8796-3db4e2324105 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance to original state: 'active'
Oct 30 09:26:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-afa0f39f-9245-4f59-81d7-2f4d6fc47dfc req-498f7910-fdc7-4327-94ae-bf2641d4804e service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-changed-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-afa0f39f-9245-4f59-81d7-2f4d6fc47dfc req-498f7910-fdc7-4327-94ae-bf2641d4804e service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Refreshing instance network info cache due to event network-changed-7c7cadfe-ab46-4565-8b85-a5fcd123707c. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-afa0f39f-9245-4f59-81d7-2f4d6fc47dfc req-498f7910-fdc7-4327-94ae-bf2641d4804e service nova] Acquiring lock "refresh_cache-bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-afa0f39f-9245-4f59-81d7-2f4d6fc47dfc req-498f7910-fdc7-4327-94ae-bf2641d4804e service nova] Acquired lock "refresh_cache-bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG nova.network.neutron [req-afa0f39f-9245-4f59-81d7-2f4d6fc47dfc req-498f7910-fdc7-4327-94ae-bf2641d4804e service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Refreshing network info cache for port 7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:26:06 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f574374d-8672-4215-b099-2b663288f6ab is timed out.
Oct 30 09:26:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Successfully detached device vdb from instance f574374d-8672-4215-b099-2b663288f6ab from the live domain config.
Oct 30 09:26:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVfrvSjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:26:06 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ad3eca-0d85-4807-a236-e7d7a6b538b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:26:06 user nova-compute[75017]: No targets found.
Oct 30 09:26:06 user nova-compute[75017]: iSNS:
Oct 30 09:26:06 user nova-compute[75017]: No targets found.
Oct 30 09:26:06 user nova-compute[75017]: STATIC:
Oct 30 09:26:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a
Oct 30 09:26:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:26:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:26:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:26:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:26:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:26:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb
Oct 30 09:26:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:26:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:26:06 user nova-compute[75017]: FIRMWARE:
Oct 30 09:26:06 user nova-compute[75017]: No targets found.
Oct 30 09:26:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:26:06 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:26:06 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570f151-c662-4e72-a2a3-0aa530814990]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5d72ee-8b4d-4c04-b767-fe1037c51342]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:26:06 user nova-compute[75017]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)
Oct 30 09:26:06 user nova-compute[75017]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:26:06 user nova-compute[75017]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb (non-flash)
Oct 30 09:26:06 user nova-compute[75017]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd900d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cf5a7f-d07a-480c-ade1-d3bb176257a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7cbce6-6c3a-4246-a502-bbd3d81b4bd2]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[319c6431-aeb7-43a3-b505-e6220c7eb490]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8113a926-528b-4255-ad17-081020baa0bc]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e081c3c9-24d9-47f0-8bb9-fa4b2f2aff85]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG nova.network.neutron [req-afa0f39f-9245-4f59-81d7-2f4d6fc47dfc req-498f7910-fdc7-4327-94ae-bf2641d4804e service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Updated VIF entry in instance network info cache for port 7c7cadfe-ab46-4565-8b85-a5fcd123707c. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG nova.network.neutron [req-afa0f39f-9245-4f59-81d7-2f4d6fc47dfc req-498f7910-fdc7-4327-94ae-bf2641d4804e service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Updating instance_info_cache with network_info: [{"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-afa0f39f-9245-4f59-81d7-2f4d6fc47dfc req-498f7910-fdc7-4327-94ae-bf2641d4804e service nova] Releasing lock "refresh_cache-bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0fb75e-6a25-4d2f-affc-04a59eec39b7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb, portal: 172.16.0.220,3260]
Oct 30 09:26:06 user nova-compute[75017]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb, portal: 172.16.0.220,3260] successful.
Oct 30 09:26:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1475865e-44ec-4351-9720-982a67618beb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b6d19f-fbae-4e12-9fc5-24985f7d9388]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] <== disconnect_volume: return (402ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:26:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:07 user nova-compute[75017]: DEBUG nova.objects.instance [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lazy-loading 'flavor' on Instance uuid f574374d-8672-4215-b099-2b663288f6ab {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:26:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-743b0960-7372-407b-a619-409b9e56c1b0 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.050s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:11 user nova-compute[75017]: INFO nova.compute.manager [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Detaching volume 8fb8b553-33bf-471c-be3d-0a31327c0c5a
Oct 30 09:26:11 user nova-compute[75017]: INFO nova.virt.block_device [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Attempting to driver detach volume 8fb8b553-33bf-471c-be3d-0a31327c0c5a from mountpoint /dev/vdb
Oct 30 09:26:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Attempting to detach device vdb from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:26:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:26:11 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:26:11 user nova-compute[75017]:   <source dev="/dev/sde"/>
Oct 30 09:26:11 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:26:11 user nova-compute[75017]:   <serial>8fb8b553-33bf-471c-be3d-0a31327c0c5a</serial>
Oct 30 09:26:11 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:26:11 user nova-compute[75017]: </disk>
Oct 30 09:26:11 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:26:11 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Successfully detached device vdb from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 from the persistent domain config.
Oct 30 09:26:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:26:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:26:11 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:26:11 user nova-compute[75017]:   <source dev="/dev/sde"/>
Oct 30 09:26:11 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:26:11 user nova-compute[75017]:   <serial>8fb8b553-33bf-471c-be3d-0a31327c0c5a</serial>
Oct 30 09:26:11 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:26:11 user nova-compute[75017]: </disk>
Oct 30 09:26:11 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:26:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:26:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-974c083e-62d6-4c68-9e41-0ffe45b450de req-b2b0815a-09cd-4bd1-92d6-81480b022d1d service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received event network-changed-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-974c083e-62d6-4c68-9e41-0ffe45b450de req-b2b0815a-09cd-4bd1-92d6-81480b022d1d service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Refreshing instance network info cache due to event network-changed-9479211b-0f43-425a-bee1-9db956bbb5a9. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:26:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-974c083e-62d6-4c68-9e41-0ffe45b450de req-b2b0815a-09cd-4bd1-92d6-81480b022d1d service nova] Acquiring lock "refresh_cache-e2abbf92-799d-4786-92f3-6310abeb534b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:26:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-974c083e-62d6-4c68-9e41-0ffe45b450de req-b2b0815a-09cd-4bd1-92d6-81480b022d1d service nova] Acquired lock "refresh_cache-e2abbf92-799d-4786-92f3-6310abeb534b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:26:12 user nova-compute[75017]: DEBUG nova.network.neutron [req-974c083e-62d6-4c68-9e41-0ffe45b450de req-b2b0815a-09cd-4bd1-92d6-81480b022d1d service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Refreshing network info cache for port 9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:26:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:12 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'flavor' on Instance uuid e2abbf92-799d-4786-92f3-6310abeb534b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:26:12 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Ignoring supplied device name: /dev/vdb
Oct 30 09:26:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:13 user nova-compute[75017]: INFO nova.compute.manager [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Attaching volume 834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 to /dev/vdb
Oct 30 09:26:13 user nova-compute[75017]: DEBUG nova.network.neutron [req-974c083e-62d6-4c68-9e41-0ffe45b450de req-b2b0815a-09cd-4bd1-92d6-81480b022d1d service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Updated VIF entry in instance network info cache for port 9479211b-0f43-425a-bee1-9db956bbb5a9. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG nova.network.neutron [req-974c083e-62d6-4c68-9e41-0ffe45b450de req-b2b0815a-09cd-4bd1-92d6-81480b022d1d service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Updating instance_info_cache with network_info: [{"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-974c083e-62d6-4c68-9e41-0ffe45b450de req-b2b0815a-09cd-4bd1-92d6-81480b022d1d service nova] Releasing lock "refresh_cache-e2abbf92-799d-4786-92f3-6310abeb534b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.utils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb1ee05-a8bd-49f3-9e8c-45c62e99a437]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6387b8ba-0940-44e8-91e3-d7aba8a0ddfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f4b1b9-7437-45e3-bcff-7a4832792c5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1109322-2c8f-4eb6-829d-52255be1bd91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:26:13 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[398cb46c-982f-48a8-9d9c-21d2128e1256]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.utils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Updating existing volume attachment record: 73d156ac-b16f-4c1e-b3be-8ae21e0d3fb1 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG nova.objects.instance [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'flavor' on Instance uuid bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:13 user nova-compute[75017]: INFO nova.compute.manager [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Attaching volume db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 to /dev/vdb
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.utils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ac48c4-841f-42f2-8b02-2f88ee37b381]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f4affc-7d00-45c6-9824-7993c651aa77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[782f5da9-2d47-4efa-b52b-8336a76a8aa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fbbe24-567a-438c-afa3-c57099c6886e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:26:13 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:26:13 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[209be2fe-49ec-43d5-a9a5-f115b51efba5]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG os_brick.utils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:26:13 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Updating existing volume attachment record: 72f982b8-f642-4208-a3b3-fa9aa8ee22c8 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:26:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:16 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:16 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:17 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:25 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:26:25 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7109MB free_disk=25.130741119384766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e44fccb6-efe6-461a-91d0-bf1628183258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f574374d-8672-4215-b099-2b663288f6ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e2abbf92-799d-4786-92f3-6310abeb534b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1af08de5-92f6-44fc-aa50-0130c5068105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7f87386d-6a8e-4095-8ef5-405810b32730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:26:25 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:26:26 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:26:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:26 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:26:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:26:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:26:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:26:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updating instance_info_cache with network_info: [{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:26:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:26:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:26:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:26:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:26:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:32 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 is timed out.
Oct 30 09:26:32 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Successfully detached device vdb from instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 from the live domain config.
Oct 30 09:26:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziJKvdXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:26:32 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab713261-9306-4a46-ad70-41c99cb4b008]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:26:32 user nova-compute[75017]: No targets found.
Oct 30 09:26:32 user nova-compute[75017]: iSNS:
Oct 30 09:26:32 user nova-compute[75017]: No targets found.
Oct 30 09:26:32 user nova-compute[75017]: STATIC:
Oct 30 09:26:32 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a
Oct 30 09:26:32 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:26:32 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:26:32 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:26:32 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:26:32 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:26:32 user nova-compute[75017]: FIRMWARE:
Oct 30 09:26:32 user nova-compute[75017]: No targets found.
Oct 30 09:26:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:26:32 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:26:32 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[540ec9d1-b6d8-43ab-91d6-82abc9fb7cf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e0778f-eca3-4051-9df4-d68a664844bf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:26:32 user nova-compute[75017]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a (non-flash)
Oct 30 09:26:32 user nova-compute[75017]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d14269630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a'): ({'sde'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Removing single pathed devices sde {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba51de5-a6f1-4987-869c-8ed1479a2ad5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[278b2831-42c0-4216-ab49-f29f2a3d6f0c]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Flushing IO for device /dev/sde {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa27687-ffa5-4556-96f0-ff6032bd74da]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37e48cb-eadf-4de7-9cc2-661370543245]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f595c337-c16b-4d94-9531-2303ddb5e3a4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[99535993-9073-421d-acac-0a04d1a95439]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a, portal: 172.16.0.220,3260]
Oct 30 09:26:32 user nova-compute[75017]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a, portal: 172.16.0.220,3260] successful.
Oct 30 09:26:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb8b553-33bf-471c-be3d-0a31327c0c5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c46391b-7757-4c40-9745-c71bf7fd8bce]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] <== disconnect_volume: return (343ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:26:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYhuOdEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:26:35 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:26:35 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:26:35 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6fecd1-6cde-4936-a008-1109d499213a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:26:35 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd7aeb5-b049-41e7-b46f-36ca2c2cc1f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7] added
Oct 30 09:26:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBXDThnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:26:35 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6265b234-ee47-4604-93f0-9dd6e3733932]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2011ee-1790-48f1-96d3-c559eddd1634]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYhuOdEj {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYhuOdEj" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbce8506-b870-49cc-a117-88651638574b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYhuOdEj'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bf7ba8-3e36-414b-ab25-ede5e89cd494]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fece01a-4fa2-41e3-8390-f3e4279f112d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e24c445-d817-40d0-95a5-1e160667ba12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7, portal: 172.16.0.220,3260]
Oct 30 09:26:35 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7, portal: 172.16.0.220,3260] successful.
Oct 30 09:26:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:35 user nova-compute[75017]: INFO nova.compute.manager [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Terminating instance
Oct 30 09:26:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ac612b-02d6-4e33-8a06-5abbeeddbddf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323f01d-9822-4b64-b01d-a8e61d83ea4c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:35 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:26:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:35 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:26:35 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8421cf-d330-4278-9dfd-95d7f5b15033]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYhuOdEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-264a22e6-d635-4464-b244-f6aa01766b2a req-84346ab5-0cd1-4907-86d8-54b1da58e35f service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received event network-vif-unplugged-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-264a22e6-d635-4464-b244-f6aa01766b2a req-84346ab5-0cd1-4907-86d8-54b1da58e35f service nova] Acquiring lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-264a22e6-d635-4464-b244-f6aa01766b2a req-84346ab5-0cd1-4907-86d8-54b1da58e35f service nova] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-264a22e6-d635-4464-b244-f6aa01766b2a req-84346ab5-0cd1-4907-86d8-54b1da58e35f service nova] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-264a22e6-d635-4464-b244-f6aa01766b2a req-84346ab5-0cd1-4907-86d8-54b1da58e35f service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] No waiting events found dispatching network-vif-unplugged-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:26:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-264a22e6-d635-4464-b244-f6aa01766b2a req-84346ab5-0cd1-4907-86d8-54b1da58e35f service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received event network-vif-unplugged-06e70bc3-b779-49b1-be07-0e5247690823 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:26:36 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Instance destroyed successfully.
Oct 30 09:26:36 user nova-compute[75017]: DEBUG nova.objects.instance [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lazy-loading 'resources' on Instance uuid 35e56f63-7e8b-4324-b16c-b4fac5bb0087 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-237423123',display_name='tempest-ServerActionsTestOtherA-server-237423123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-237423123',id=3,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVf6zqMoogIIj/uVm0rJdIGAUOFQTJWmuf99t8ZCINTOFKb0EfkIlJX2kMG++VhQZ9/3YDSeCpCZrAjAjPqkbtlMQdQ8cwrIE78waAfMQ+vnF0Yf8L48jhmZjd9BMvMIA==',key_name='tempest-keypair-2124767111',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20765fc27454d25a1f53e540a8cb4fc',ramdisk_id='',reservation_id='r-x1nmgmdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1280782381',owner_user_name='tempest-ServerActionsTestOtherA-1280782381-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257ef30aa08d49a387932c340a8589c5',uuid=35e56f63-7e8b-4324-b16c-b4fac5bb0087,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converting VIF {"id": "06e70bc3-b779-49b1-be07-0e5247690823", "address": "fa:16:3e:0f:2b:90", "network": {"id": "b0f83e08-53ea-4ba8-9cb7-9938e09f35e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1034327414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20765fc27454d25a1f53e540a8cb4fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e70bc3-b7", "ovs_interfaceid": "06e70bc3-b779-49b1-be07-0e5247690823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:2b:90,bridge_name='br-int',has_traffic_filtering=True,id=06e70bc3-b779-49b1-be07-0e5247690823,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e70bc3-b7') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_vif [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:2b:90,bridge_name='br-int',has_traffic_filtering=True,id=06e70bc3-b779-49b1-be07-0e5247690823,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e70bc3-b7') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06e70bc3-b7, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=620b24ff-977f-40f7-9b73-94a0275d94ae) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:26:36 user nova-compute[75017]: INFO os_vif [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:2b:90,bridge_name='br-int',has_traffic_filtering=True,id=06e70bc3-b779-49b1-be07-0e5247690823,network=Network(b0f83e08-53ea-4ba8-9cb7-9938e09f35e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e70bc3-b7')
Oct 30 09:26:36 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Deleting instance files /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087_del
Oct 30 09:26:36 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Deletion of /opt/stack/data/nova/instances/35e56f63-7e8b-4324-b16c-b4fac5bb0087_del complete
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23661623939326537', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661623939326537', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.303s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:26:36 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:26:36 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'flavor' on Instance uuid e2abbf92-799d-4786-92f3-6310abeb534b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:26:36 user nova-compute[75017]: INFO nova.compute.manager [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Took 1.09 seconds to destroy the instance on the hypervisor.
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cd19de-66dd-43e0-8be7-b3a0a1d7a3e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:26:36 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:26:36 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:26:36 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:26:36 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:26:36 user nova-compute[75017]:   <serial>834e5fe1-cdff-42e6-b00c-bb6e5bc697a7</serial>
Oct 30 09:26:36 user nova-compute[75017]: </disk>
Oct 30 09:26:36 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8c0b5-7e45-4883-a26f-9c1c2f289bc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69] added
Oct 30 09:26:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eae5a7-7193-462c-aef6-51be4b7672c2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[693fad4c-d9f7-472d-81c9-26635142e11c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBXDThnG {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBXDThnG" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e25e6f4-c35c-439e-89eb-52e4a195b054]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBXDThnG'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea456f4-ad0c-4c04-822d-e67058652497]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea86356-54dc-4f47-a72b-98e1e12b6c65]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:36 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:26:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:36 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:26:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[20665f11-7a02-4703-b434-de78b165c12b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69, portal: 172.16.0.220,3260]
Oct 30 09:26:36 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69, portal: 172.16.0.220,3260] successful.
Oct 30 09:26:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc733da1-25a5-4c17-8972-4fd03a3c74cd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[80838242-3373-46a5-b0f0-c6996a40112a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:36 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:26:36 user nova-compute[75017]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 (non-flash)
Oct 30 09:26:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:26:36 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:26:36 user nova-compute[75017]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 (non-flash)
Oct 30 09:26:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[328a971f-d62a-4916-a94e-27b3d5cfa722]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] No VIF found with MAC fa:16:3e:c6:ea:e2, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b4e174d4-d675-444f-8662-57fca003a240 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.056s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:26:37 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Took 0.92 seconds to deallocate network for instance.
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-fc6fd17a-ae31-4b2f-9137-e939e854c627 req-35b350c8-249b-4e81-808e-4df2f0381aca service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received event network-vif-deleted-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:37 user nova-compute[75017]: INFO nova.compute.manager [req-fc6fd17a-ae31-4b2f-9137-e939e854c627 req-35b350c8-249b-4e81-808e-4df2f0381aca service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Neutron deleted interface 06e70bc3-b779-49b1-be07-0e5247690823; detaching it from the instance and deleting it from the info cache
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.network.neutron [req-fc6fd17a-ae31-4b2f-9137-e939e854c627 req-35b350c8-249b-4e81-808e-4df2f0381aca service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-fc6fd17a-ae31-4b2f-9137-e939e854c627 req-35b350c8-249b-4e81-808e-4df2f0381aca service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Detach interface failed, port_id=06e70bc3-b779-49b1-be07-0e5247690823, reason: Instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-47cf456b-55cb-4ded-b8a6-e1652eebef79 req-d2c831ae-7c6d-44e3-bd48-29769164e9b6 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received event network-vif-plugged-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47cf456b-55cb-4ded-b8a6-e1652eebef79 req-d2c831ae-7c6d-44e3-bd48-29769164e9b6 service nova] Acquiring lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47cf456b-55cb-4ded-b8a6-e1652eebef79 req-d2c831ae-7c6d-44e3-bd48-29769164e9b6 service nova] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47cf456b-55cb-4ded-b8a6-e1652eebef79 req-d2c831ae-7c6d-44e3-bd48-29769164e9b6 service nova] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-47cf456b-55cb-4ded-b8a6-e1652eebef79 req-d2c831ae-7c6d-44e3-bd48-29769164e9b6 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] No waiting events found dispatching network-vif-plugged-06e70bc3-b779-49b1-be07-0e5247690823 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:26:37 user nova-compute[75017]: WARNING nova.compute.manager [req-47cf456b-55cb-4ded-b8a6-e1652eebef79 req-d2c831ae-7c6d-44e3-bd48-29769164e9b6 service nova] [instance: 35e56f63-7e8b-4324-b16c-b4fac5bb0087] Received unexpected event network-vif-plugged-06e70bc3-b779-49b1-be07-0e5247690823 for instance with vm_state deleted and task_state None.
Oct 30 09:26:37 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBXDThnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] <== connect_volume: return (2666ms) {'type': 'block', 'scsi_wwn': '23366323633636535', 'path': '/dev/sdd'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366323633636535', 'path': '/dev/sdd'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.objects.instance [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'flavor' on Instance uuid bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:26:37 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:26:37 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:26:37 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:26:37 user nova-compute[75017]:   <serial>db5b6ad9-ac44-4b0f-8335-6f59c3c7df69</serial>
Oct 30 09:26:37 user nova-compute[75017]: </disk>
Oct 30 09:26:37 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:26:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:38 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Deleted allocations for instance 35e56f63-7e8b-4324-b16c-b4fac5bb0087
Oct 30 09:26:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bc46d448-05b8-4457-bd2e-af4921094aa8 tempest-ServerActionsTestOtherA-1280782381 tempest-ServerActionsTestOtherA-1280782381-project-member] Lock "35e56f63-7e8b-4324-b16c-b4fac5bb0087" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.747s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:26:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:26:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] No VIF found with MAC fa:16:3e:9b:f9:ab, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:26:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9390baed-2445-4b1c-ac36-a21a75d4ed59 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.810s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:39 user nova-compute[75017]: INFO nova.compute.manager [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Detaching volume db5b6ad9-ac44-4b0f-8335-6f59c3c7df69
Oct 30 09:26:40 user nova-compute[75017]: INFO nova.virt.block_device [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Attempting to driver detach volume db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 from mountpoint /dev/vdb
Oct 30 09:26:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Attempting to detach device vdb from instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:26:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:26:40 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:26:40 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:26:40 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:26:40 user nova-compute[75017]:   <serial>db5b6ad9-ac44-4b0f-8335-6f59c3c7df69</serial>
Oct 30 09:26:40 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:26:40 user nova-compute[75017]: </disk>
Oct 30 09:26:40 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:26:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully detached device vdb from instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d from the persistent domain config.
Oct 30 09:26:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:26:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:26:40 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:26:40 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:26:40 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:26:40 user nova-compute[75017]:   <serial>db5b6ad9-ac44-4b0f-8335-6f59c3c7df69</serial>
Oct 30 09:26:40 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:26:40 user nova-compute[75017]: </disk>
Oct 30 09:26:40 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:26:40 user nova-compute[75017]: DEBUG nova.objects.instance [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lazy-loading 'flavor' on Instance uuid e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:26:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:26:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-48ebaa07-a211-4f23-bda7-ed7aae101297 tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.147s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-82f13713-897f-441a-9910-90597bc77e45 req-6fc80cd3-a8da-40d0-ba00-00fddb5fd872 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-changed-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-82f13713-897f-441a-9910-90597bc77e45 req-6fc80cd3-a8da-40d0-ba00-00fddb5fd872 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Refreshing instance network info cache due to event network-changed-9705cc2d-9b13-4281-ad14-89ecc4a8cb48. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-82f13713-897f-441a-9910-90597bc77e45 req-6fc80cd3-a8da-40d0-ba00-00fddb5fd872 service nova] Acquiring lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-82f13713-897f-441a-9910-90597bc77e45 req-6fc80cd3-a8da-40d0-ba00-00fddb5fd872 service nova] Acquired lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG nova.network.neutron [req-82f13713-897f-441a-9910-90597bc77e45 req-6fc80cd3-a8da-40d0-ba00-00fddb5fd872 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Refreshing network info cache for port 9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG nova.objects.instance [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'flavor' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:43 user nova-compute[75017]: INFO nova.compute.manager [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Attaching volume cb8bd736-e5f3-427b-9b33-11ca1968da59 to /dev/vdb
Oct 30 09:26:43 user nova-compute[75017]: DEBUG nova.network.neutron [req-82f13713-897f-441a-9910-90597bc77e45 req-6fc80cd3-a8da-40d0-ba00-00fddb5fd872 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updated VIF entry in instance network info cache for port 9705cc2d-9b13-4281-ad14-89ecc4a8cb48. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG nova.network.neutron [req-82f13713-897f-441a-9910-90597bc77e45 req-6fc80cd3-a8da-40d0-ba00-00fddb5fd872 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating instance_info_cache with network_info: [{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG os_brick.utils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-82f13713-897f-441a-9910-90597bc77e45 req-6fc80cd3-a8da-40d0-ba00-00fddb5fd872 service nova] Releasing lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6492db3e-0bce-42d2-b4b4-02ee3b3a3d0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab05304d-b71e-42b4-bdee-7afd92730bbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[23437f2a-b301-4198-9870-e46cbf010911]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[55870fc7-ab13-4082-8356-bb729977687f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:26:43 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:26:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9309774c-173b-4b74-af67-ac02b6b06a31]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG os_brick.utils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:26:43 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating existing volume attachment record: 6d55ea07-a258-4112-8f0f-72f2e5c7b1d0 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:26:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:47 user nova-compute[75017]: INFO nova.compute.manager [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Terminating instance
Oct 30 09:26:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a02224e-38d6-45a6-bdfa-304d1cea9295 req-57094d32-d725-4f24-ab74-e1d331edcfd4 service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received event network-vif-unplugged-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a02224e-38d6-45a6-bdfa-304d1cea9295 req-57094d32-d725-4f24-ab74-e1d331edcfd4 service nova] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a02224e-38d6-45a6-bdfa-304d1cea9295 req-57094d32-d725-4f24-ab74-e1d331edcfd4 service nova] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a02224e-38d6-45a6-bdfa-304d1cea9295 req-57094d32-d725-4f24-ab74-e1d331edcfd4 service nova] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a02224e-38d6-45a6-bdfa-304d1cea9295 req-57094d32-d725-4f24-ab74-e1d331edcfd4 service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] No waiting events found dispatching network-vif-unplugged-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:26:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a02224e-38d6-45a6-bdfa-304d1cea9295 req-57094d32-d725-4f24-ab74-e1d331edcfd4 service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received event network-vif-unplugged-9e28ff70-628f-4e32-b24b-19676f74db8e for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:26:48 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f574374d-8672-4215-b099-2b663288f6ab] Instance destroyed successfully.
Oct 30 09:26:48 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lazy-loading 'resources' on Instance uuid f574374d-8672-4215-b099-2b663288f6ab {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-67720669',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-67720669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6772066',id=27,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqhY4Xp9vgtiWid5h98BER16QjvU1cSgpT4iYzN/dmcPpKDZE0foUQLJVWvVX6Wgtf9QV/s9d2z3nUfuqbLzk0CP0wG6Fte6p692Qed4/voE6vRSUTrHFvKNKMHeX876g==',key_name='tempest-keypair-36117091',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daace2dab68b4ca4a8146a4c0615b7ac',ramdisk_id='',reservation_id='r-heh90eec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1064777854',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:23:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fb84f4be3744bfa1cbae9073d698e5',uuid=f574374d-8672-4215-b099-2b663288f6ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Converting VIF {"id": "9e28ff70-628f-4e32-b24b-19676f74db8e", "address": "fa:16:3e:4d:e5:dc", "network": {"id": "c1900997-3004-4697-9b5b-bb6ba5f9924f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-800845771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daace2dab68b4ca4a8146a4c0615b7ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e28ff70-62", "ovs_interfaceid": "9e28ff70-628f-4e32-b24b-19676f74db8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:e5:dc,bridge_name='br-int',has_traffic_filtering=True,id=9e28ff70-628f-4e32-b24b-19676f74db8e,network=Network(c1900997-3004-4697-9b5b-bb6ba5f9924f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e28ff70-62') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG os_vif [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:e5:dc,bridge_name='br-int',has_traffic_filtering=True,id=9e28ff70-628f-4e32-b24b-19676f74db8e,network=Network(c1900997-3004-4697-9b5b-bb6ba5f9924f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e28ff70-62') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e28ff70-62, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=053b4b00-4efb-4916-8fc9-34c92a042fd2) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:48 user nova-compute[75017]: INFO os_vif [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:e5:dc,bridge_name='br-int',has_traffic_filtering=True,id=9e28ff70-628f-4e32-b24b-19676f74db8e,network=Network(c1900997-3004-4697-9b5b-bb6ba5f9924f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e28ff70-62')
Oct 30 09:26:48 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Deleting instance files /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab_del
Oct 30 09:26:48 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Deletion of /opt/stack/data/nova/instances/f574374d-8672-4215-b099-2b663288f6ab_del complete
Oct 30 09:26:48 user nova-compute[75017]: INFO nova.compute.manager [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] [instance: f574374d-8672-4215-b099-2b663288f6ab] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 30 09:26:48 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: f574374d-8672-4215-b099-2b663288f6ab] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:26:48 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: f574374d-8672-4215-b099-2b663288f6ab] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: f574374d-8672-4215-b099-2b663288f6ab] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:26:49 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: f574374d-8672-4215-b099-2b663288f6ab] Took 1.10 seconds to deallocate network for instance.
Oct 30 09:26:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-adc46c4b-a2a2-4ca3-86e6-99a90d8bc4e3 req-98c5429b-252f-4355-bcb0-0bd9e28073af service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received event network-vif-deleted-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-36aff2a6-e9dc-4b0a-8304-6bed74381bc4 req-ba9ca55d-b42f-45bb-a9e6-7b4bd28b1e9f service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received event network-vif-plugged-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36aff2a6-e9dc-4b0a-8304-6bed74381bc4 req-ba9ca55d-b42f-45bb-a9e6-7b4bd28b1e9f service nova] Acquiring lock "f574374d-8672-4215-b099-2b663288f6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36aff2a6-e9dc-4b0a-8304-6bed74381bc4 req-ba9ca55d-b42f-45bb-a9e6-7b4bd28b1e9f service nova] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-36aff2a6-e9dc-4b0a-8304-6bed74381bc4 req-ba9ca55d-b42f-45bb-a9e6-7b4bd28b1e9f service nova] Lock "f574374d-8672-4215-b099-2b663288f6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-36aff2a6-e9dc-4b0a-8304-6bed74381bc4 req-ba9ca55d-b42f-45bb-a9e6-7b4bd28b1e9f service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] No waiting events found dispatching network-vif-plugged-9e28ff70-628f-4e32-b24b-19676f74db8e {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:26:49 user nova-compute[75017]: WARNING nova.compute.manager [req-36aff2a6-e9dc-4b0a-8304-6bed74381bc4 req-ba9ca55d-b42f-45bb-a9e6-7b4bd28b1e9f service nova] [instance: f574374d-8672-4215-b099-2b663288f6ab] Received unexpected event network-vif-plugged-9e28ff70-628f-4e32-b24b-19676f74db8e for instance with vm_state deleted and task_state None.
Oct 30 09:26:49 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:26:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:49 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Deleted allocations for instance f574374d-8672-4215-b099-2b663288f6ab
Oct 30 09:26:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f484f546-cda0-486c-be9c-71173697f84a tempest-TestServerVolumeAttachScenarioOldVersion-1064777854 tempest-TestServerVolumeAttachScenarioOldVersion-1064777854-project-member] Lock "f574374d-8672-4215-b099-2b663288f6ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.785s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:26:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:26:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:00 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d is timed out.
Oct 30 09:27:00 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully detached device vdb from instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d from the live domain config.
Oct 30 09:27:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBXDThnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:27:00 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc3605-9369-4250-890f-4cb7cd8d71cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:27:00 user nova-compute[75017]: No targets found.
Oct 30 09:27:00 user nova-compute[75017]: iSNS:
Oct 30 09:27:00 user nova-compute[75017]: No targets found.
Oct 30 09:27:00 user nova-compute[75017]: STATIC:
Oct 30 09:27:00 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:27:00 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:27:00 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:27:00 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69
Oct 30 09:27:00 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:27:00 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:27:00 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7
Oct 30 09:27:00 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:27:00 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:27:00 user nova-compute[75017]: FIRMWARE:
Oct 30 09:27:00 user nova-compute[75017]: No targets found.
Oct 30 09:27:00 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:27:00 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:27:00 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[db52b82d-9fcc-4bc0-aab9-32a930a7f920]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[513100d7-ae10-4d45-b783-69146e6c8fa9]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:00 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:27:00 user nova-compute[75017]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 (non-flash)
Oct 30 09:27:00 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:00 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:27:00 user nova-compute[75017]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 (non-flash)
Oct 30 09:27:00 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd91000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69'): ({'sdd'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Removing single pathed devices sdd {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ed6014-945f-41be-a09e-d9ee7e6781b7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[27132e93-b076-4b45-bef8-62e90c79fba8]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Flushing IO for device /dev/sdd {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9128a4e-b396-45b1-b6d5-46ef6041e06b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbccc754-2a8a-4008-be2b-67b4cb352961]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1675a94e-b991-45e0-ae17-bc2d02b2c82d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4992f5b-ddec-4296-9c8f-da8d957e5a21]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69, portal: 172.16.0.220,3260]
Oct 30 09:27:00 user nova-compute[75017]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69, portal: 172.16.0.220,3260] successful.
Oct 30 09:27:00 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b6ad9-ac44-4b0f-8335-6f59c3c7df69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5ec75a-5bb7-489b-92c1-1e903ccd1724]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] <== disconnect_volume: return (322ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:27:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:01 user nova-compute[75017]: DEBUG nova.objects.instance [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'flavor' on Instance uuid bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3f7d33f8-c01c-48b4-9707-14038575aaf1 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.910s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:01 user nova-compute[75017]: INFO nova.compute.manager [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Terminating instance
Oct 30 09:27:01 user nova-compute[75017]: DEBUG nova.compute.manager [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-dbdd87b2-67a1-4efb-b480-6f0e43f187cd req-54ed38b2-607d-442b-b573-2116f7917989 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received event network-vif-unplugged-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dbdd87b2-67a1-4efb-b480-6f0e43f187cd req-54ed38b2-607d-442b-b573-2116f7917989 service nova] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dbdd87b2-67a1-4efb-b480-6f0e43f187cd req-54ed38b2-607d-442b-b573-2116f7917989 service nova] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dbdd87b2-67a1-4efb-b480-6f0e43f187cd req-54ed38b2-607d-442b-b573-2116f7917989 service nova] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-dbdd87b2-67a1-4efb-b480-6f0e43f187cd req-54ed38b2-607d-442b-b573-2116f7917989 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] No waiting events found dispatching network-vif-unplugged-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-dbdd87b2-67a1-4efb-b480-6f0e43f187cd req-54ed38b2-607d-442b-b573-2116f7917989 service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received event network-vif-unplugged-693ab1d1-4966-4d21-b6e5-acc42f756616 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:02 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Instance destroyed successfully.
Oct 30 09:27:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lazy-loading 'resources' on Instance uuid e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:22:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1392445499',display_name='tempest-TestServerVolumeAttachmentScenario-server-1392445499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1392445499',id=26,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJApGoNdNqqxNy3f0BvCik9pU/Krb6whPXzdVcgZGepLQcAEqb8SVsYgQRHJsfIcAndaps3zsWL4Ryukrrdo4SrcTkP6yWrJPxF++IJsQfE7g5vBfjtmRpZAAZ/WR2+mcA==',key_name='tempest-keypair-1287253571',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:22:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a579aacbbc394c4db05d043fa6d820f9',ramdisk_id='',reservation_id='r-1tx739p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1952307507',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1952307507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98269e46a4d84a02ac9db10534cb7f3f',uuid=e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Converting VIF {"id": "693ab1d1-4966-4d21-b6e5-acc42f756616", "address": "fa:16:3e:32:a2:a2", "network": {"id": "d4ee91b5-e709-455d-ac99-daec15892268", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970991107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a579aacbbc394c4db05d043fa6d820f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693ab1d1-49", "ovs_interfaceid": "693ab1d1-4966-4d21-b6e5-acc42f756616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:a2,bridge_name='br-int',has_traffic_filtering=True,id=693ab1d1-4966-4d21-b6e5-acc42f756616,network=Network(d4ee91b5-e709-455d-ac99-daec15892268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693ab1d1-49') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG os_vif [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:a2,bridge_name='br-int',has_traffic_filtering=True,id=693ab1d1-4966-4d21-b6e5-acc42f756616,network=Network(d4ee91b5-e709-455d-ac99-daec15892268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693ab1d1-49') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap693ab1d1-49, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c056cfeb-fb23-4221-be6e-3ee29e5ed295) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:03 user nova-compute[75017]: INFO os_vif [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:a2,bridge_name='br-int',has_traffic_filtering=True,id=693ab1d1-4966-4d21-b6e5-acc42f756616,network=Network(d4ee91b5-e709-455d-ac99-daec15892268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693ab1d1-49')
Oct 30 09:27:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Deleting instance files /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3_del
Oct 30 09:27:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Deletion of /opt/stack/data/nova/instances/e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3_del complete
Oct 30 09:27:03 user nova-compute[75017]: INFO nova.compute.manager [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Took 1.12 seconds to destroy the instance on the hypervisor.
Oct 30 09:27:03 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:27:03 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:27:04 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Took 1.00 seconds to deallocate network for instance.
Oct 30 09:27:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-ee4a20ef-192a-4c6f-965d-e463c935da18 req-8e2eac13-2b41-4d26-8ded-564cffeb601f service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received event network-vif-deleted-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-d0fb2d72-b4b0-4016-9e7b-603e52f94854 req-085c71d3-357b-45c2-b2ed-c9f9993a34eb service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received event network-vif-plugged-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d0fb2d72-b4b0-4016-9e7b-603e52f94854 req-085c71d3-357b-45c2-b2ed-c9f9993a34eb service nova] Acquiring lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d0fb2d72-b4b0-4016-9e7b-603e52f94854 req-085c71d3-357b-45c2-b2ed-c9f9993a34eb service nova] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d0fb2d72-b4b0-4016-9e7b-603e52f94854 req-085c71d3-357b-45c2-b2ed-c9f9993a34eb service nova] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-d0fb2d72-b4b0-4016-9e7b-603e52f94854 req-085c71d3-357b-45c2-b2ed-c9f9993a34eb service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] No waiting events found dispatching network-vif-plugged-693ab1d1-4966-4d21-b6e5-acc42f756616 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:04 user nova-compute[75017]: WARNING nova.compute.manager [req-d0fb2d72-b4b0-4016-9e7b-603e52f94854 req-085c71d3-357b-45c2-b2ed-c9f9993a34eb service nova] [instance: e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3] Received unexpected event network-vif-plugged-693ab1d1-4966-4d21-b6e5-acc42f756616 for instance with vm_state deleted and task_state None.
Oct 30 09:27:04 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:27:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.543s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:04 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Deleted allocations for instance e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3
Oct 30 09:27:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9a101a55-df86-4129-b9ee-62df9732e93f tempest-TestServerVolumeAttachmentScenario-1952307507 tempest-TestServerVolumeAttachmentScenario-1952307507-project-member] Lock "e4f1fdc9-49ec-4ce8-86f2-d10d9daab6a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.897s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyzDkoeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:27:05 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:27:05 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:27:05 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb3cfb-b708-4095-bf93-582fca894761]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:27:05 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d877fcba-98ee-4b8d-90d0-7f580bb8ffc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59] added
Oct 30 09:27:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab55011-3078-4588-9b9a-f03574c785bc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[862c6d1a-5ca6-4c20-85d1-fd2301bfc81a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyzDkoeq {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyzDkoeq" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc4819b-145d-48b6-ae55-f6ab33b762e5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xyzDkoeq'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[263ac326-cd1b-4391-a68a-0e52efc2b33a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[492189c8-864f-4a1f-9d31-516362fb1892]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:05 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:27:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:05 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:27:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[631dd9cf-6d46-4861-be1d-48523c9db76b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59, portal: 172.16.0.220,3260]
Oct 30 09:27:05 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59, portal: 172.16.0.220,3260] successful.
Oct 30 09:27:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa9f674-da1c-4779-a8e1-f5eb2d117f2b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b2f90f-6894-41dd-8691-51884708e5cf]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:05 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:27:05 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:27:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:05 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:27:05 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:27:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c765f-0a53-4c5e-93c4-d66d043181b8]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:27:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyzDkoeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:27:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:27:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26235653237333733', 'path': '/dev/sdd'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:27:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235653237333733', 'path': '/dev/sdd'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:27:06 user nova-compute[75017]: DEBUG nova.objects.instance [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'flavor' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:27:06 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:27:06 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:27:06 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:27:06 user nova-compute[75017]:   <serial>cb8bd736-e5f3-427b-9b33-11ca1968da59</serial>
Oct 30 09:27:06 user nova-compute[75017]: </disk>
Oct 30 09:27:06 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:27:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:27:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:27:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No VIF found with MAC fa:16:3e:1d:c8:de, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:27:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-72efb82c-e0dd-4bd7-a917-f0f26f349170 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.736s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:07 user nova-compute[75017]: INFO nova.compute.manager [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Rescuing
Oct 30 09:27:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:27:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquired lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:27:07 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:27:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:08 user nova-compute[75017]: DEBUG nova.network.neutron [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating instance_info_cache with network_info: [{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:27:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Releasing lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:27:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-dc61383a-acd5-4186-9bd9-f3736504e2ae req-2bf42b9b-4322-4fc4-9804-21eb14b22161 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-unplugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dc61383a-acd5-4186-9bd9-f3736504e2ae req-2bf42b9b-4322-4fc4-9804-21eb14b22161 service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dc61383a-acd5-4186-9bd9-f3736504e2ae req-2bf42b9b-4322-4fc4-9804-21eb14b22161 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dc61383a-acd5-4186-9bd9-f3736504e2ae req-2bf42b9b-4322-4fc4-9804-21eb14b22161 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-dc61383a-acd5-4186-9bd9-f3736504e2ae req-2bf42b9b-4322-4fc4-9804-21eb14b22161 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-unplugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:09 user nova-compute[75017]: WARNING nova.compute.manager [req-dc61383a-acd5-4186-9bd9-f3736504e2ae req-2bf42b9b-4322-4fc4-9804-21eb14b22161 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-unplugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state active and task_state rescuing.
Oct 30 09:27:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:09 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Instance destroyed successfully.
Oct 30 09:27:09 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Attempting rescue
Oct 30 09:27:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75017) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Instance directory exists: not creating {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 09:27:09 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Creating image(s)
Oct 30 09:27:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG nova.objects.instance [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.252s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue" returned: 0 in 0.088s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.instance [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'migration_context' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.base [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<1af08de5-92f6-44fc-aa50-0130c5068105> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Start _get_guest_xml network_info=[{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "vif_mac": "fa:16:3e:1d:c8:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.instance [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'resources' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.base [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<1af08de5-92f6-44fc-aa50-0130c5068105> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.instance [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'numa_topology' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.base [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<1af08de5-92f6-44fc-aa50-0130c5068105> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:27:10 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:27:10 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.instance [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.base [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<1af08de5-92f6-44fc-aa50-0130c5068105> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1156699622',display_name='tempest-ServerRescueNegativeTestJSON-server-1156699622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1156699622',id=31,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiHkKVhHb4iClThemee7bcrZuhx1I0GTqPzFzJCYdqnn/591lr36roMoemqs/9t5XrCdCtjnGaSJ1MgJu8w59mmdzFwcuHWexzVhY1j8x7K4JD2IYmVciSWDWtJo80Riw==',key_name='tempest-keypair-409353962',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-5u4n2omd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b340dac0544150bc642f7ecfb07157',uuid=1af08de5-92f6-44fc-aa50-0130c5068105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "vif_mac": "fa:16:3e:1d:c8:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "vif_mac": "fa:16:3e:1d:c8:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c8:de,bridge_name='br-int',has_traffic_filtering=True,id=9705cc2d-9b13-4281-ad14-89ecc4a8cb48,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9705cc2d-9b') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.instance [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'pci_devices' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.objects.base [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Object Instance<1af08de5-92f6-44fc-aa50-0130c5068105> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:27:10 user nova-compute[75017]:   <uuid>1af08de5-92f6-44fc-aa50-0130c5068105</uuid>
Oct 30 09:27:10 user nova-compute[75017]:   <name>instance-0000001f</name>
Oct 30 09:27:10 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:27:10 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:27:10 user nova-compute[75017]:   <metadata>
Oct 30 09:27:10 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:27:10 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:27:10 user nova-compute[75017]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1156699622</nova:name>
Oct 30 09:27:10 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:27:10</nova:creationTime>
Oct 30 09:27:10 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:27:10 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:27:10 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:27:10 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:27:10 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:27:10 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:27:10 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:27:10 user nova-compute[75017]:       <nova:owner>
Oct 30 09:27:10 user nova-compute[75017]:         <nova:user uuid="e7b340dac0544150bc642f7ecfb07157">tempest-ServerRescueNegativeTestJSON-1002551965-project-member</nova:user>
Oct 30 09:27:10 user nova-compute[75017]:         <nova:project uuid="8c1e0e03de5c497a94c9c6267e623573">tempest-ServerRescueNegativeTestJSON-1002551965</nova:project>
Oct 30 09:27:10 user nova-compute[75017]:       </nova:owner>
Oct 30 09:27:10 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:27:10 user nova-compute[75017]:       <nova:ports>
Oct 30 09:27:10 user nova-compute[75017]:         <nova:port uuid="9705cc2d-9b13-4281-ad14-89ecc4a8cb48">
Oct 30 09:27:10 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 09:27:10 user nova-compute[75017]:         </nova:port>
Oct 30 09:27:10 user nova-compute[75017]:       </nova:ports>
Oct 30 09:27:10 user nova-compute[75017]:     </nova:instance>
Oct 30 09:27:10 user nova-compute[75017]:   </metadata>
Oct 30 09:27:10 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:27:10 user nova-compute[75017]:     <system>
Oct 30 09:27:10 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:27:10 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:27:10 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:27:10 user nova-compute[75017]:       <entry name="serial">1af08de5-92f6-44fc-aa50-0130c5068105</entry>
Oct 30 09:27:10 user nova-compute[75017]:       <entry name="uuid">1af08de5-92f6-44fc-aa50-0130c5068105</entry>
Oct 30 09:27:10 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:27:10 user nova-compute[75017]:     </system>
Oct 30 09:27:10 user nova-compute[75017]:   </sysinfo>
Oct 30 09:27:10 user nova-compute[75017]:   <os>
Oct 30 09:27:10 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:27:10 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:27:10 user nova-compute[75017]:   </os>
Oct 30 09:27:10 user nova-compute[75017]:   <features>
Oct 30 09:27:10 user nova-compute[75017]:     <acpi/>
Oct 30 09:27:10 user nova-compute[75017]:     <apic/>
Oct 30 09:27:10 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:27:10 user nova-compute[75017]:   </features>
Oct 30 09:27:10 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:27:10 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:27:10 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:27:10 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:27:10 user nova-compute[75017]:   </clock>
Oct 30 09:27:10 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:27:10 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:27:10 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:27:10 user nova-compute[75017]:   </cpu>
Oct 30 09:27:10 user nova-compute[75017]:   <devices>
Oct 30 09:27:10 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:27:10 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:27:10 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue"/>
Oct 30 09:27:10 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:27:10 user nova-compute[75017]:     </disk>
Oct 30 09:27:10 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:27:10 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:27:10 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk"/>
Oct 30 09:27:10 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:27:10 user nova-compute[75017]:     </disk>
Oct 30 09:27:10 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:27:10 user nova-compute[75017]:       <mac address="fa:16:3e:1d:c8:de"/>
Oct 30 09:27:10 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:27:10 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:27:10 user nova-compute[75017]:       <target dev="tap9705cc2d-9b"/>
Oct 30 09:27:10 user nova-compute[75017]:     </interface>
Oct 30 09:27:10 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:27:10 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/console.log" append="off"/>
Oct 30 09:27:10 user nova-compute[75017]:     </serial>
Oct 30 09:27:10 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:27:10 user nova-compute[75017]:     <video>
Oct 30 09:27:10 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:27:10 user nova-compute[75017]:     </video>
Oct 30 09:27:10 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:27:10 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:27:10 user nova-compute[75017]:     </rng>
Oct 30 09:27:10 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:27:10 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:27:10 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:27:10 user nova-compute[75017]:     </memballoon>
Oct 30 09:27:10 user nova-compute[75017]:   </devices>
Oct 30 09:27:10 user nova-compute[75017]: </domain>
Oct 30 09:27:10 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:27:10 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Instance destroyed successfully.
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:27:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] No VIF found with MAC fa:16:3e:1d:c8:de, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:27:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-02d46fe9-d3b9-4e68-8112-c8f90816d57d req-f442f366-5918-4886-812b-f51000620c0d service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-02d46fe9-d3b9-4e68-8112-c8f90816d57d req-f442f366-5918-4886-812b-f51000620c0d service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-02d46fe9-d3b9-4e68-8112-c8f90816d57d req-f442f366-5918-4886-812b-f51000620c0d service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-02d46fe9-d3b9-4e68-8112-c8f90816d57d req-f442f366-5918-4886-812b-f51000620c0d service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-02d46fe9-d3b9-4e68-8112-c8f90816d57d req-f442f366-5918-4886-812b-f51000620c0d service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:11 user nova-compute[75017]: WARNING nova.compute.manager [req-02d46fe9-d3b9-4e68-8112-c8f90816d57d req-f442f366-5918-4886-812b-f51000620c0d service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state active and task_state rescuing.
Oct 30 09:27:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:13 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-cf52a946-07a6-4963-b645-c3d273cebc20 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:27:16 user nova-compute[75017]: INFO nova.compute.claims [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Claim successful on node user
Oct 30 09:27:16 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:27:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:27:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:27:16 user nova-compute[75017]: DEBUG nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG nova.policy [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57fc74a319ac45e4b8f9f14b172d5e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d796755933441bfaff1fb821cc2ad9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-acdc9760-b145-4f71-a069-5e5827b13b62 req-614e261c-3940-4271-9a13-86a1d71d14e6 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-acdc9760-b145-4f71-a069-5e5827b13b62 req-614e261c-3940-4271-9a13-86a1d71d14e6 service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-acdc9760-b145-4f71-a069-5e5827b13b62 req-614e261c-3940-4271-9a13-86a1d71d14e6 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-acdc9760-b145-4f71-a069-5e5827b13b62 req-614e261c-3940-4271-9a13-86a1d71d14e6 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-acdc9760-b145-4f71-a069-5e5827b13b62 req-614e261c-3940-4271-9a13-86a1d71d14e6 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:17 user nova-compute[75017]: WARNING nova.compute.manager [req-acdc9760-b145-4f71-a069-5e5827b13b62 req-614e261c-3940-4271-9a13-86a1d71d14e6 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state rescued and task_state None.
Oct 30 09:27:17 user nova-compute[75017]: DEBUG nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:27:17 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Creating image(s)
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.236s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.225s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk 1073741824" returned: 0 in 0.065s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Successfully created port: 5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:27:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Cannot resize image /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Ensure instance console log exists: /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG nova.network.neutron [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Successfully updated port: 5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquired lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG nova.network.neutron [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-bc6428fe-dada-459f-b6ac-08670e1b0ac7 req-aa8b86d8-61b8-4a84-beea-e5d657d3ed69 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-changed-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-bc6428fe-dada-459f-b6ac-08670e1b0ac7 req-aa8b86d8-61b8-4a84-beea-e5d657d3ed69 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Refreshing instance network info cache due to event network-changed-5d294406-a8a6-4939-925a-3a5a72dbc2f5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bc6428fe-dada-459f-b6ac-08670e1b0ac7 req-aa8b86d8-61b8-4a84-beea-e5d657d3ed69 service nova] Acquiring lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:27:18 user nova-compute[75017]: DEBUG nova.network.neutron [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-0a0e21c5-2c16-427a-a6af-b7bce09efb94 req-d6745f55-2ff2-4a4d-80fa-31fa82f0ee1e service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0a0e21c5-2c16-427a-a6af-b7bce09efb94 req-d6745f55-2ff2-4a4d-80fa-31fa82f0ee1e service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0a0e21c5-2c16-427a-a6af-b7bce09efb94 req-d6745f55-2ff2-4a4d-80fa-31fa82f0ee1e service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0a0e21c5-2c16-427a-a6af-b7bce09efb94 req-d6745f55-2ff2-4a4d-80fa-31fa82f0ee1e service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-0a0e21c5-2c16-427a-a6af-b7bce09efb94 req-d6745f55-2ff2-4a4d-80fa-31fa82f0ee1e service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:19 user nova-compute[75017]: WARNING nova.compute.manager [req-0a0e21c5-2c16-427a-a6af-b7bce09efb94 req-d6745f55-2ff2-4a4d-80fa-31fa82f0ee1e service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state rescued and task_state None.
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.network.neutron [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating instance_info_cache with network_info: [{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Releasing lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance network_info: |[{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bc6428fe-dada-459f-b6ac-08670e1b0ac7 req-aa8b86d8-61b8-4a84-beea-e5d657d3ed69 service nova] Acquired lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-bc6428fe-dada-459f-b6ac-08670e1b0ac7 req-aa8b86d8-61b8-4a84-beea-e5d657d3ed69 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Refreshing network info cache for port 5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Start _get_guest_xml network_info=[{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:27:19 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:27:19 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1080550565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1080550565',id=33,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUVzmLwbiPXmN9NnSoYBIvC/rFJO8MjqfeNSMbICD5lP9UAYd18J188Rw97Qor3U45PP3nRzLD6zD+fkYyhh9wdWYbFeUn75NgKrAsJb+o4booXMiG+U6LFXn34r9ao1A==',key_name='tempest-keypair-595798195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-30au1thv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:27:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.objects.instance [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'pci_devices' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:27:19 user nova-compute[75017]:   <uuid>f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12</uuid>
Oct 30 09:27:19 user nova-compute[75017]:   <name>instance-00000021</name>
Oct 30 09:27:19 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:27:19 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:27:19 user nova-compute[75017]:   <metadata>
Oct 30 09:27:19 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:27:19 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:27:19 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1080550565</nova:name>
Oct 30 09:27:19 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:27:19</nova:creationTime>
Oct 30 09:27:19 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:27:19 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:27:19 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:27:19 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:27:19 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:27:19 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:27:19 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:27:19 user nova-compute[75017]:       <nova:owner>
Oct 30 09:27:19 user nova-compute[75017]:         <nova:user uuid="57fc74a319ac45e4b8f9f14b172d5e17">tempest-AttachVolumeShelveTestJSON-1409612729-project-member</nova:user>
Oct 30 09:27:19 user nova-compute[75017]:         <nova:project uuid="2d796755933441bfaff1fb821cc2ad9a">tempest-AttachVolumeShelveTestJSON-1409612729</nova:project>
Oct 30 09:27:19 user nova-compute[75017]:       </nova:owner>
Oct 30 09:27:19 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:27:19 user nova-compute[75017]:       <nova:ports>
Oct 30 09:27:19 user nova-compute[75017]:         <nova:port uuid="5d294406-a8a6-4939-925a-3a5a72dbc2f5">
Oct 30 09:27:19 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 09:27:19 user nova-compute[75017]:         </nova:port>
Oct 30 09:27:19 user nova-compute[75017]:       </nova:ports>
Oct 30 09:27:19 user nova-compute[75017]:     </nova:instance>
Oct 30 09:27:19 user nova-compute[75017]:   </metadata>
Oct 30 09:27:19 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:27:19 user nova-compute[75017]:     <system>
Oct 30 09:27:19 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:27:19 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:27:19 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:27:19 user nova-compute[75017]:       <entry name="serial">f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12</entry>
Oct 30 09:27:19 user nova-compute[75017]:       <entry name="uuid">f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12</entry>
Oct 30 09:27:19 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:27:19 user nova-compute[75017]:     </system>
Oct 30 09:27:19 user nova-compute[75017]:   </sysinfo>
Oct 30 09:27:19 user nova-compute[75017]:   <os>
Oct 30 09:27:19 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:27:19 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:27:19 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:27:19 user nova-compute[75017]:   </os>
Oct 30 09:27:19 user nova-compute[75017]:   <features>
Oct 30 09:27:19 user nova-compute[75017]:     <acpi/>
Oct 30 09:27:19 user nova-compute[75017]:     <apic/>
Oct 30 09:27:19 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:27:19 user nova-compute[75017]:   </features>
Oct 30 09:27:19 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:27:19 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:27:19 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:27:19 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:27:19 user nova-compute[75017]:   </clock>
Oct 30 09:27:19 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:27:19 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:27:19 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:27:19 user nova-compute[75017]:   </cpu>
Oct 30 09:27:19 user nova-compute[75017]:   <devices>
Oct 30 09:27:19 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:27:19 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:27:19 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk"/>
Oct 30 09:27:19 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:27:19 user nova-compute[75017]:     </disk>
Oct 30 09:27:19 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:27:19 user nova-compute[75017]:       <mac address="fa:16:3e:c5:da:8b"/>
Oct 30 09:27:19 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:27:19 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:27:19 user nova-compute[75017]:       <target dev="tap5d294406-a8"/>
Oct 30 09:27:19 user nova-compute[75017]:     </interface>
Oct 30 09:27:19 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:27:19 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/console.log" append="off"/>
Oct 30 09:27:19 user nova-compute[75017]:     </serial>
Oct 30 09:27:19 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:27:19 user nova-compute[75017]:     <video>
Oct 30 09:27:19 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:27:19 user nova-compute[75017]:     </video>
Oct 30 09:27:19 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:27:19 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:27:19 user nova-compute[75017]:     </rng>
Oct 30 09:27:19 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:27:19 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:27:19 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:27:19 user nova-compute[75017]:     </memballoon>
Oct 30 09:27:19 user nova-compute[75017]:   </devices>
Oct 30 09:27:19 user nova-compute[75017]: </domain>
Oct 30 09:27:19 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1080550565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1080550565',id=33,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUVzmLwbiPXmN9NnSoYBIvC/rFJO8MjqfeNSMbICD5lP9UAYd18J188Rw97Qor3U45PP3nRzLD6zD+fkYyhh9wdWYbFeUn75NgKrAsJb+o4booXMiG+U6LFXn34r9ao1A==',key_name='tempest-keypair-595798195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-30au1thv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:27:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG os_vif [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae814f89-e73d-5c71-a123-dd480dcee4a2', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d294406-a8, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d294406-a8, col_values=(('qos', UUID('6c0fb7e8-e3e2-4a81-995a-fbdbe02fd0c1')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d294406-a8, col_values=(('external_ids', {'iface-id': '5d294406-a8a6-4939-925a-3a5a72dbc2f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:da:8b', 'vm-uuid': 'f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:19 user nova-compute[75017]: INFO os_vif [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8')
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:27:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] No VIF found with MAC fa:16:3e:c5:da:8b, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:27:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-bc6428fe-dada-459f-b6ac-08670e1b0ac7 req-aa8b86d8-61b8-4a84-beea-e5d657d3ed69 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updated VIF entry in instance network info cache for port 5d294406-a8a6-4939-925a-3a5a72dbc2f5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:27:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-bc6428fe-dada-459f-b6ac-08670e1b0ac7 req-aa8b86d8-61b8-4a84-beea-e5d657d3ed69 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating instance_info_cache with network_info: [{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:27:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bc6428fe-dada-459f-b6ac-08670e1b0ac7 req-aa8b86d8-61b8-4a84-beea-e5d657d3ed69 service nova] Releasing lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:27:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:27:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:27:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:20 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-030136c3-56de-4bb0-8c09-29ec673a4ffc req-2d6e0a51-6497-439a-bdd7-3a940776a53f service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-030136c3-56de-4bb0-8c09-29ec673a4ffc req-2d6e0a51-6497-439a-bdd7-3a940776a53f service nova] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-030136c3-56de-4bb0-8c09-29ec673a4ffc req-2d6e0a51-6497-439a-bdd7-3a940776a53f service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-030136c3-56de-4bb0-8c09-29ec673a4ffc req-2d6e0a51-6497-439a-bdd7-3a940776a53f service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-030136c3-56de-4bb0-8c09-29ec673a4ffc req-2d6e0a51-6497-439a-bdd7-3a940776a53f service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] No waiting events found dispatching network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:21 user nova-compute[75017]: WARNING nova.compute.manager [req-030136c3-56de-4bb0-8c09-29ec673a4ffc req-2d6e0a51-6497-439a-bdd7-3a940776a53f service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received unexpected event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 for instance with vm_state building and task_state spawning.
Oct 30 09:27:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-2213f1fa-23b7-4935-bcc9-85d72181ead2 req-35723209-9092-452f-a0c9-0f836fc050c6 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2213f1fa-23b7-4935-bcc9-85d72181ead2 req-35723209-9092-452f-a0c9-0f836fc050c6 service nova] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2213f1fa-23b7-4935-bcc9-85d72181ead2 req-35723209-9092-452f-a0c9-0f836fc050c6 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2213f1fa-23b7-4935-bcc9-85d72181ead2 req-35723209-9092-452f-a0c9-0f836fc050c6 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-2213f1fa-23b7-4935-bcc9-85d72181ead2 req-35723209-9092-452f-a0c9-0f836fc050c6 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] No waiting events found dispatching network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:23 user nova-compute[75017]: WARNING nova.compute.manager [req-2213f1fa-23b7-4935-bcc9-85d72181ead2 req-35723209-9092-452f-a0c9-0f836fc050c6 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received unexpected event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 for instance with vm_state building and task_state spawning.
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:27:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance spawned successfully.
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:27:24 user nova-compute[75017]: INFO nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Took 6.96 seconds to spawn the instance on the hypervisor.
Oct 30 09:27:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:24 user nova-compute[75017]: INFO nova.compute.manager [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Took 8.03 seconds to build instance.
Oct 30 09:27:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-967e55d8-ed9a-4459-a48c-f1d0d676e069 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.162s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:29 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:27:29 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7490MB free_disk=25.19906234741211GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e44fccb6-efe6-461a-91d0-bf1628183258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e2abbf92-799d-4786-92f3-6310abeb534b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1af08de5-92f6-44fc-aa50-0130c5068105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7f87386d-6a8e-4095-8ef5-405810b32730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:27:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:30 user nova-compute[75017]: INFO nova.compute.manager [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Terminating instance
Oct 30 09:27:30 user nova-compute[75017]: DEBUG nova.compute.manager [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-e695767b-e97a-4744-830a-94cf0a4d572c req-9ce06596-f58c-41dc-92e6-018945d4b360 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-unplugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e695767b-e97a-4744-830a-94cf0a4d572c req-9ce06596-f58c-41dc-92e6-018945d4b360 service nova] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e695767b-e97a-4744-830a-94cf0a4d572c req-9ce06596-f58c-41dc-92e6-018945d4b360 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e695767b-e97a-4744-830a-94cf0a4d572c req-9ce06596-f58c-41dc-92e6-018945d4b360 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-e695767b-e97a-4744-830a-94cf0a4d572c req-9ce06596-f58c-41dc-92e6-018945d4b360 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] No waiting events found dispatching network-vif-unplugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-e695767b-e97a-4744-830a-94cf0a4d572c req-9ce06596-f58c-41dc-92e6-018945d4b360 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-unplugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Instance destroyed successfully.
Oct 30 09:27:31 user nova-compute[75017]: DEBUG nova.objects.instance [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lazy-loading 'resources' on Instance uuid bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1925502918',display_name='tempest-AttachVolumeNegativeTest-server-1925502918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1925502918',id=28,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvFNW+FZCLIn9+XJyPTCsn1OYwfOdO0Rs+T0FcTUhCcW9miflNYxtwUrx8d69RVKnLRWIZkj3muQ2JctxSPHsc6phs5FoTjew4UMFhSLX9vGL85pDbZpMUh7tD4W3LLRQ==',key_name='tempest-keypair-1675761624',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:24:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a4606fc32534a589e07baa3a4e76d48',ramdisk_id='',reservation_id='r-ogwu60ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-63898760',owner_user_name='tempest-AttachVolumeNegativeTest-63898760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edd9037b1ceb4b899f6d446b565a6ff9',uuid=bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converting VIF {"id": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "address": "fa:16:3e:9b:f9:ab", "network": {"id": "e6d86674-358c-4b1b-b539-c2c4ded0eb18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1398683455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4606fc32534a589e07baa3a4e76d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7cadfe-ab", "ovs_interfaceid": "7c7cadfe-ab46-4565-8b85-a5fcd123707c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:f9:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c7cadfe-ab46-4565-8b85-a5fcd123707c,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7cadfe-ab') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG os_vif [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:f9:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c7cadfe-ab46-4565-8b85-a5fcd123707c,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7cadfe-ab') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c7cadfe-ab, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b9ab1b6-457a-4d2e-9676-dfee113454ac) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: INFO os_vif [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:f9:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c7cadfe-ab46-4565-8b85-a5fcd123707c,network=Network(e6d86674-358c-4b1b-b539-c2c4ded0eb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7cadfe-ab')
Oct 30 09:27:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Deleting instance files /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d_del
Oct 30 09:27:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Deletion of /opt/stack/data/nova/instances/bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d_del complete
Oct 30 09:27:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:31 user nova-compute[75017]: INFO nova.compute.manager [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 30 09:27:31 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:27:31 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:27:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] No waiting events found dispatching network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:33 user nova-compute[75017]: WARNING nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received unexpected event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c for instance with vm_state active and task_state deleting.
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] No waiting events found dispatching network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:33 user nova-compute[75017]: WARNING nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received unexpected event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c for instance with vm_state active and task_state deleting.
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] No waiting events found dispatching network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:33 user nova-compute[75017]: WARNING nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received unexpected event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c for instance with vm_state active and task_state deleting.
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-unplugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] No waiting events found dispatching network-vif-unplugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-unplugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Acquiring lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] No waiting events found dispatching network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:33 user nova-compute[75017]: WARNING nova.compute.manager [req-bcb1def4-d144-48fe-8549-e8695578d984 req-2c713e1f-55b3-46fd-b481-a58ca3a34d42 service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received unexpected event network-vif-plugged-7c7cadfe-ab46-4565-8b85-a5fcd123707c for instance with vm_state active and task_state deleting.
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:27:33 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Took 1.71 seconds to deallocate network for instance.
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:27:33 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:27:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:34 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Deleted allocations for instance bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d
Oct 30 09:27:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updating instance_info_cache with network_info: [{"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:27:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0a06dd85-d1ae-4ab0-b53e-b973cca05ec0 tempest-AttachVolumeNegativeTest-63898760 tempest-AttachVolumeNegativeTest-63898760-project-member] Lock "bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.441s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:27:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:27:34 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:27:34 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:27:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:27:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:35 user nova-compute[75017]: INFO nova.compute.manager [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Detaching volume 834e5fe1-cdff-42e6-b00c-bb6e5bc697a7
Oct 30 09:27:35 user nova-compute[75017]: INFO nova.virt.block_device [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Attempting to driver detach volume 834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 from mountpoint /dev/vdb
Oct 30 09:27:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Attempting to detach device vdb from instance e2abbf92-799d-4786-92f3-6310abeb534b from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:27:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:27:35 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:27:35 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:27:35 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:27:35 user nova-compute[75017]:   <serial>834e5fe1-cdff-42e6-b00c-bb6e5bc697a7</serial>
Oct 30 09:27:35 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:27:35 user nova-compute[75017]: </disk>
Oct 30 09:27:35 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:27:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-688d5aec-ab97-418e-a9b3-b5580a88635f req-373c58fe-aed7-4821-a92a-6a3531f0f56c service nova] [instance: bed0a7e8-0e60-4a9e-bf26-5a20401d2d3d] Received event network-vif-deleted-7c7cadfe-ab46-4565-8b85-a5fcd123707c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Successfully detached device vdb from instance e2abbf92-799d-4786-92f3-6310abeb534b from the persistent domain config.
Oct 30 09:27:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2abbf92-799d-4786-92f3-6310abeb534b from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:27:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:27:35 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:27:35 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:27:35 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:27:35 user nova-compute[75017]:   <serial>834e5fe1-cdff-42e6-b00c-bb6e5bc697a7</serial>
Oct 30 09:27:35 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:27:35 user nova-compute[75017]: </disk>
Oct 30 09:27:35 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:27:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2abbf92-799d-4786-92f3-6310abeb534b {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:27:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG nova.objects.instance [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'flavor' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:37 user nova-compute[75017]: INFO nova.compute.manager [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Attaching volume e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 to /dev/vdb
Oct 30 09:27:37 user nova-compute[75017]: DEBUG os_brick.utils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4af23fe-a419-4d1a-a6fe-8484cc141796]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c444468-a1e6-4baa-a241-5d7d053cf2e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[451b6445-1e78-4426-b273-6aaf6a8cf387]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aadefe-d3be-4d50-9e98-0e92543d2b23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:27:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:27:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:27:38 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:27:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba468d94-375e-4052-83f4-b56a953fb49f]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:27:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:27:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:27:38 user nova-compute[75017]: DEBUG os_brick.utils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:27:38 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating existing volume attachment record: 1ee8c57f-d037-4e3e-8d0a-52b745c9b32c {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:27:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:56 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2abbf92-799d-4786-92f3-6310abeb534b is timed out.
Oct 30 09:27:56 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Successfully detached device vdb from instance e2abbf92-799d-4786-92f3-6310abeb534b from the live domain config.
Oct 30 09:27:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYhuOdEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:27:56 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b64ba6-86e6-41a1-a4cd-5ac27a5f7c09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:27:56 user nova-compute[75017]: No targets found.
Oct 30 09:27:56 user nova-compute[75017]: iSNS:
Oct 30 09:27:56 user nova-compute[75017]: No targets found.
Oct 30 09:27:56 user nova-compute[75017]: STATIC:
Oct 30 09:27:56 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:27:56 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:27:56 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:27:56 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59
Oct 30 09:27:56 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:27:56 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:27:56 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7
Oct 30 09:27:56 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:27:56 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:27:56 user nova-compute[75017]: FIRMWARE:
Oct 30 09:27:56 user nova-compute[75017]: No targets found.
Oct 30 09:27:56 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:27:56 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:27:56 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a41651-abad-4142-9701-50bf2aca934c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5234d049-2254-4e88-91bc-1d9bebc09cef]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:56 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:27:56 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:27:56 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:56 user nova-compute[75017]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 (non-flash)
Oct 30 09:27:56 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:27:56 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccdb1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[050bffa9-e517-4e58-9958-0f8256c61feb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23d7aca-7705-42d0-9fee-73f8c4d6da75]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0e32e1-a80d-4ce2-85cc-5cc0131a8cd1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9554a7-4938-43be-b702-a18338c59882]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2fbf3a-c836-48f9-8aa3-7d425be985de]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35dd71-46aa-4f3d-b469-aa8340ea76dc]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7, portal: 172.16.0.220,3260]
Oct 30 09:27:56 user nova-compute[75017]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7, portal: 172.16.0.220,3260] successful.
Oct 30 09:27:56 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[999bddc4-0cda-4761-94f2-73df61ba3624]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] <== disconnect_volume: return (320ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:27:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'flavor' on Instance uuid e2abbf92-799d-4786-92f3-6310abeb534b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d09c1b99-d81f-4644-af42-005c24b6d72b tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.104s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.721s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:57 user nova-compute[75017]: INFO nova.compute.manager [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Terminating instance
Oct 30 09:27:57 user nova-compute[75017]: DEBUG nova.compute.manager [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-9aecd77c-5cfc-4fb3-b241-276b11a08261 req-e6904f44-d0ee-4a6a-8bc2-13067dfc4c9f service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received event network-vif-unplugged-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9aecd77c-5cfc-4fb3-b241-276b11a08261 req-e6904f44-d0ee-4a6a-8bc2-13067dfc4c9f service nova] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9aecd77c-5cfc-4fb3-b241-276b11a08261 req-e6904f44-d0ee-4a6a-8bc2-13067dfc4c9f service nova] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9aecd77c-5cfc-4fb3-b241-276b11a08261 req-e6904f44-d0ee-4a6a-8bc2-13067dfc4c9f service nova] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-9aecd77c-5cfc-4fb3-b241-276b11a08261 req-e6904f44-d0ee-4a6a-8bc2-13067dfc4c9f service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] No waiting events found dispatching network-vif-unplugged-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-9aecd77c-5cfc-4fb3-b241-276b11a08261 req-e6904f44-d0ee-4a6a-8bc2-13067dfc4c9f service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received event network-vif-unplugged-9479211b-0f43-425a-bee1-9db956bbb5a9 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:27:58 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Instance destroyed successfully.
Oct 30 09:27:58 user nova-compute[75017]: DEBUG nova.objects.instance [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lazy-loading 'resources' on Instance uuid e2abbf92-799d-4786-92f3-6310abeb534b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1723183146',display_name='tempest-VolumesSnapshotTestJSON-instance-1723183146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1723183146',id=29,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHnJFuW9XNX099FRzqFWVBkAg6GbW915a7VjJhDfpv9H/7pu4Vvk9i2ICJ3AlA3a18aQMmqj1+01egS0jX63x+mRo4G8NqsrvQCiIfpDvarMyj1+FHdgWfiZoyl4Gw+8A==',key_name='tempest-keypair-1319410690',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:24:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2479037737af4b3e925a3d8f99c638ff',ramdisk_id='',reservation_id='r-f4clqtx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-681659515',owner_user_name='tempest-VolumesSnapshotTestJSON-681659515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5a90dea2584329b7baf5cb83236091',uuid=e2abbf92-799d-4786-92f3-6310abeb534b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converting VIF {"id": "9479211b-0f43-425a-bee1-9db956bbb5a9", "address": "fa:16:3e:c6:ea:e2", "network": {"id": "99fa2700-a20a-445c-be58-50d660832d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306193431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2479037737af4b3e925a3d8f99c638ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9479211b-0f", "ovs_interfaceid": "9479211b-0f43-425a-bee1-9db956bbb5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:ea:e2,bridge_name='br-int',has_traffic_filtering=True,id=9479211b-0f43-425a-bee1-9db956bbb5a9,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9479211b-0f') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_vif [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:ea:e2,bridge_name='br-int',has_traffic_filtering=True,id=9479211b-0f43-425a-bee1-9db956bbb5a9,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9479211b-0f') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9479211b-0f, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0634607f-6810-4c62-8bf3-f3ee2ca99d1c) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:27:58 user nova-compute[75017]: INFO os_vif [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:ea:e2,bridge_name='br-int',has_traffic_filtering=True,id=9479211b-0f43-425a-bee1-9db956bbb5a9,network=Network(99fa2700-a20a-445c-be58-50d660832d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9479211b-0f')
Oct 30 09:27:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYhuOdEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:27:58 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0d67d9-27f7-41e5-b10d-a69bbbbf0cc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:27:58 user nova-compute[75017]: No targets found.
Oct 30 09:27:58 user nova-compute[75017]: iSNS:
Oct 30 09:27:58 user nova-compute[75017]: No targets found.
Oct 30 09:27:58 user nova-compute[75017]: STATIC:
Oct 30 09:27:58 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:27:58 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:27:58 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:27:58 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59
Oct 30 09:27:58 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:27:58 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:27:58 user nova-compute[75017]: FIRMWARE:
Oct 30 09:27:58 user nova-compute[75017]: No targets found.
Oct 30 09:27:58 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:27:58 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:27:58 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:834e5fe1-cdff-42e6-b00c-bb6e5bc697a7', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f8377-497c-4e32-83af-d35dd5da1730]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f56c156-6eb7-4998-aa89-cfcccc751a5d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:58 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:27:58 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:27:58 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:27:58 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf07e2680>, {}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Disconnecting from: [] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] <== disconnect_volume: return (84ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:27:58 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Deleting instance files /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b_del
Oct 30 09:27:58 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Deletion of /opt/stack/data/nova/instances/e2abbf92-799d-4786-92f3-6310abeb534b_del complete
Oct 30 09:27:58 user nova-compute[75017]: INFO nova.compute.manager [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 30 09:27:58 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:27:58 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:27:59 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Took 0.90 seconds to deallocate network for instance.
Oct 30 09:27:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-63364ae5-eba4-4d1a-ad37-75663598d2d8 req-b002de55-f0d7-4fb0-98d8-bcc371402f32 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received event network-vif-deleted-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:59 user nova-compute[75017]: INFO nova.compute.manager [req-63364ae5-eba4-4d1a-ad37-75663598d2d8 req-b002de55-f0d7-4fb0-98d8-bcc371402f32 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Neutron deleted interface 9479211b-0f43-425a-bee1-9db956bbb5a9; detaching it from the instance and deleting it from the info cache
Oct 30 09:27:59 user nova-compute[75017]: DEBUG nova.network.neutron [req-63364ae5-eba4-4d1a-ad37-75663598d2d8 req-b002de55-f0d7-4fb0-98d8-bcc371402f32 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:27:59 user nova-compute[75017]: WARNING nova.volume.cinder [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Attachment 73d156ac-b16f-4c1e-b3be-8ae21e0d3fb1 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 73d156ac-b16f-4c1e-b3be-8ae21e0d3fb1. (HTTP 404) (Request-ID: req-9ab3c08f-e4ae-4002-b4e1-253e76b7c1ae)
Oct 30 09:27:59 user nova-compute[75017]: INFO nova.compute.manager [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Took 0.03 seconds to detach 1 volumes for instance.
Oct 30 09:27:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-63364ae5-eba4-4d1a-ad37-75663598d2d8 req-b002de55-f0d7-4fb0-98d8-bcc371402f32 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Detach interface failed, port_id=9479211b-0f43-425a-bee1-9db956bbb5a9, reason: Instance e2abbf92-799d-4786-92f3-6310abeb534b could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-5526e6db-126f-4e5c-9d3d-ccb45e322b07 req-cc2519d6-8127-4da6-b575-7dcc40c12ea1 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received event network-vif-plugged-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5526e6db-126f-4e5c-9d3d-ccb45e322b07 req-cc2519d6-8127-4da6-b575-7dcc40c12ea1 service nova] Acquiring lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5526e6db-126f-4e5c-9d3d-ccb45e322b07 req-cc2519d6-8127-4da6-b575-7dcc40c12ea1 service nova] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-5526e6db-126f-4e5c-9d3d-ccb45e322b07 req-cc2519d6-8127-4da6-b575-7dcc40c12ea1 service nova] Lock "e2abbf92-799d-4786-92f3-6310abeb534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-5526e6db-126f-4e5c-9d3d-ccb45e322b07 req-cc2519d6-8127-4da6-b575-7dcc40c12ea1 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] No waiting events found dispatching network-vif-plugged-9479211b-0f43-425a-bee1-9db956bbb5a9 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:27:59 user nova-compute[75017]: WARNING nova.compute.manager [req-5526e6db-126f-4e5c-9d3d-ccb45e322b07 req-cc2519d6-8127-4da6-b575-7dcc40c12ea1 service nova] [instance: e2abbf92-799d-4786-92f3-6310abeb534b] Received unexpected event network-vif-plugged-9479211b-0f43-425a-bee1-9db956bbb5a9 for instance with vm_state deleted and task_state None.
Oct 30 09:27:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:27:59 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Deleted allocations for instance e2abbf92-799d-4786-92f3-6310abeb534b
Oct 30 09:28:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-62d63ace-4e99-42d2-8697-9ccec8bf9bb9 tempest-VolumesSnapshotTestJSON-681659515 tempest-VolumesSnapshotTestJSON-681659515-project-member] Lock "e2abbf92-799d-4786-92f3-6310abeb534b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.549s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:28:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:00 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:28:00 user nova-compute[75017]: INFO nova.compute.claims [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Claim successful on node user
Oct 30 09:28:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:28:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:28:01 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:28:01 user nova-compute[75017]: INFO nova.virt.block_device [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Booting with volume 2380b941-e961-4298-9cb7-586dbcfd2600 at /dev/vda
Oct 30 09:28:01 user nova-compute[75017]: DEBUG nova.policy [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb0397935e524c6c9da95caa125a1627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e979003a534f9f844a4c60ae72c6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG os_brick.utils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[725a621e-ffed-4ac7-8b90-b2afd64e5552]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef19b5-5968-494d-9581-51497c9ffb56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b219cc51-5d76-4bbc-b83b-ebfb6c502225]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a8c669-e1c7-4363-8af6-8716d1e98353]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:28:01 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:28:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac49e5d-c7b5-4333-839e-a17efb6b3d32]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG os_brick.utils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:28:01 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating existing volume attachment record: a2f50fd5-fd72-4fb5-b993-1bbfefd60915 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:28:02 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Successfully created port: 0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Successfully updated port: 0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquired lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-30c27b5e-444b-4ff6-a153-e64be3b06941 req-b7ca419a-edeb-4acd-94a0-6bc4865ad6fc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-30c27b5e-444b-4ff6-a153-e64be3b06941 req-b7ca419a-edeb-4acd-94a0-6bc4865ad6fc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing instance network info cache due to event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-30c27b5e-444b-4ff6-a153-e64be3b06941 req-b7ca419a-edeb-4acd-94a0-6bc4865ad6fc service nova] Acquiring lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Releasing lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Instance network_info: |[{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-30c27b5e-444b-4ff6-a153-e64be3b06941 req-b7ca419a-edeb-4acd-94a0-6bc4865ad6fc service nova] Acquired lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-30c27b5e-444b-4ff6-a153-e64be3b06941 req-b7ca419a-edeb-4acd-94a0-6bc4865ad6fc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-30c27b5e-444b-4ff6-a153-e64be3b06941 req-b7ca419a-edeb-4acd-94a0-6bc4865ad6fc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updated VIF entry in instance network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-30c27b5e-444b-4ff6-a153-e64be3b06941 req-b7ca419a-edeb-4acd-94a0-6bc4865ad6fc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-30c27b5e-444b-4ff6-a153-e64be3b06941 req-b7ca419a-edeb-4acd-94a0-6bc4865ad6fc service nova] Releasing lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:28:04 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:04 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:28:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFOVBohH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:28:10 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:28:10 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:28:10 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c757b91-b55e-40b4-b883-72dd119a66e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:28:10 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[64446723-abbc-4304-b2ba-776197355e25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6] added
Oct 30 09:28:10 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8b4652-4b99-4f07-8962-762f7ef64db3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fee81a-6123-435f-9704-a32b50142dad]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFOVBohH {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFOVBohH" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8793faf6-903f-4fa9-8075-6a28bb7f8c0f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fFOVBohH'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f59cc14-3f07-46bd-9a64-f8f1f61ae5ad]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af3e88c-328b-491e-a89d-4ac1ef13fc41]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:28:10 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:10 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:28:10 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:10 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ab81ca-6b96-4a9e-8adf-341e8b4e562e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260]
Oct 30 09:28:10 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260] successful.
Oct 30 09:28:10 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4039119-33cd-44ab-9d98-5ddfb2987816]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8d9875-a2e9-406f-b096-6093c069b10e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:28:10 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:10 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:10 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:28:10 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:10 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:10 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bfca81-cf70-433c-842a-81167b6ecd62]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:10 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:28:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:11 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:28:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFOVBohH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:28:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:28:11 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23231616634636165', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:28:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231616634636165', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:28:11 user nova-compute[75017]: DEBUG nova.objects.instance [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'flavor' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:28:11 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:28:11 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:28:11 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:28:11 user nova-compute[75017]:   <serial>e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6</serial>
Oct 30 09:28:11 user nova-compute[75017]: </disk>
Oct 30 09:28:11 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:28:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:28:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:28:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No VIF found with MAC fa:16:3e:e8:3b:d2, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:28:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-76b4021f-85f4-40d8-95e5-a67876d462f1 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.695s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:13 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:28:18 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:19 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:20 user nova-compute[75017]: INFO nova.compute.manager [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Terminating instance
Oct 30 09:28:20 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-789fa491-49a4-45ab-ba31-301945de6c4a req-f2c262a9-d83e-458a-a5ee-bacca683d3af service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-789fa491-49a4-45ab-ba31-301945de6c4a req-f2c262a9-d83e-458a-a5ee-bacca683d3af service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-789fa491-49a4-45ab-ba31-301945de6c4a req-f2c262a9-d83e-458a-a5ee-bacca683d3af service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-789fa491-49a4-45ab-ba31-301945de6c4a req-f2c262a9-d83e-458a-a5ee-bacca683d3af service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-789fa491-49a4-45ab-ba31-301945de6c4a req-f2c262a9-d83e-458a-a5ee-bacca683d3af service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-789fa491-49a4-45ab-ba31-301945de6c4a req-f2c262a9-d83e-458a-a5ee-bacca683d3af service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-unplugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:28:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Instance destroyed successfully.
Oct 30 09:28:21 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lazy-loading 'resources' on Instance uuid 28c7433c-4edd-4d5b-8d9c-68308998a508 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-605656703',display_name='tempest-ServerActionsTestOtherB-server-605656703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-605656703',id=19,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsO3D8imqXadqbsvenS1ZFOBMwiMnHotDuidmowiAb2AKB1yeka44kaMsm8Bk0/3S4Tx29wUyIzxAdVbBUzhcdNcjZWvbYuXl0341auprHHVWRadGKrbSxoWPFvfh13Q==',key_name='tempest-keypair-1868016218',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b631fb81c2fc4dc1a7ab30957279de25',ramdisk_id='',reservation_id='r-edgijgvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-794901056',owner_user_name='tempest-ServerActionsTestOtherB-794901056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:26:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32be8c463bb84c4baa5c8af3900ac613',uuid=28c7433c-4edd-4d5b-8d9c-68308998a508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converting VIF {"id": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "address": "fa:16:3e:7b:86:de", "network": {"id": "3cf871b0-79cf-4c0a-ad7b-46b3f2994057", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30976403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b631fb81c2fc4dc1a7ab30957279de25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb5467b-29", "ovs_interfaceid": "6eb5467b-29cc-4ead-87d9-46828d9a797b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_vif [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eb5467b-29, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a151e2d0-d5b9-4940-8bd0-92965ddac19e) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:21 user nova-compute[75017]: INFO os_vif [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:86:de,bridge_name='br-int',has_traffic_filtering=True,id=6eb5467b-29cc-4ead-87d9-46828d9a797b,network=Network(3cf871b0-79cf-4c0a-ad7b-46b3f2994057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb5467b-29')
Oct 30 09:28:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOurUpga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:28:21 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8470a336-ee94-47ef-90ce-361400526017]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:28:21 user nova-compute[75017]: No targets found.
Oct 30 09:28:21 user nova-compute[75017]: iSNS:
Oct 30 09:28:21 user nova-compute[75017]: No targets found.
Oct 30 09:28:21 user nova-compute[75017]: STATIC:
Oct 30 09:28:21 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6
Oct 30 09:28:21 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:28:21 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:28:21 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d
Oct 30 09:28:21 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:28:21 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:28:21 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59
Oct 30 09:28:21 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:28:21 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:28:21 user nova-compute[75017]: FIRMWARE:
Oct 30 09:28:21 user nova-compute[75017]: No targets found.
Oct 30 09:28:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:28:21 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:28:21 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e145ffb-909e-4709-b98e-5a75bc11cfc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc976a73-5567-47a8-8f11-fcde6fc9e2d6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:28:21 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:21 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d (non-flash)
Oct 30 09:28:21 user nova-compute[75017]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:21 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd78430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a61aee-27cc-4d10-aaa2-947d6c5ddf3c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2218c5dd-96ce-4623-a8c2-b10b61a1115e]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f721b-ec88-4995-916e-b21be5a41d0d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47b859f-42a6-475f-b3a1-87f3964ed3a3]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ba510d-4393-4ced-b862-88829de5f881]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d1fc63-9bca-43a2-8fcd-c62046d61773]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260]
Oct 30 09:28:21 user nova-compute[75017]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d, portal: 172.16.0.220,3260] successful.
Oct 30 09:28:21 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce6e7a43-efa8-446e-8f59-1f9116c5664d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab9b9f8-a093-456e-b938-9a2d74c10176]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] <== disconnect_volume: return (424ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:28:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Deleting instance files /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508_del
Oct 30 09:28:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Deletion of /opt/stack/data/nova/instances/28c7433c-4edd-4d5b-8d9c-68308998a508_del complete
Oct 30 09:28:21 user nova-compute[75017]: INFO nova.compute.manager [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Took 1.47 seconds to destroy the instance on the hypervisor.
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:28:22 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid '28c7433c-4edd-4d5b-8d9c-68308998a508' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid '28c7433c-4edd-4d5b-8d9c-68308998a508' (instance-00000013)
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-cfa00321-350e-474d-9cd3-7e09db1713f2 req-596ec944-0e4e-47a8-ac63-dee16f14d4d4 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cfa00321-350e-474d-9cd3-7e09db1713f2 req-596ec944-0e4e-47a8-ac63-dee16f14d4d4 service nova] Acquiring lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cfa00321-350e-474d-9cd3-7e09db1713f2 req-596ec944-0e4e-47a8-ac63-dee16f14d4d4 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cfa00321-350e-474d-9cd3-7e09db1713f2 req-596ec944-0e4e-47a8-ac63-dee16f14d4d4 service nova] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-cfa00321-350e-474d-9cd3-7e09db1713f2 req-596ec944-0e4e-47a8-ac63-dee16f14d4d4 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] No waiting events found dispatching network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:22 user nova-compute[75017]: WARNING nova.compute.manager [req-cfa00321-350e-474d-9cd3-7e09db1713f2 req-596ec944-0e4e-47a8-ac63-dee16f14d4d4 service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received unexpected event network-vif-plugged-6eb5467b-29cc-4ead-87d9-46828d9a797b for instance with vm_state active and task_state deleting.
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:23 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Took 1.81 seconds to deallocate network for instance.
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-d9d574ee-db2e-43f5-a1c1-0ffae2a85e56 req-fcb20d9c-9990-4645-a980-81c6767c397d service nova] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Received event network-vif-deleted-6eb5467b-29cc-4ead-87d9-46828d9a797b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:28:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Creating image(s)
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Ensure instance console log exists: /opt/stack/data/nova/instances/ed764905-0085-48a3-ab16-0b108bedf0b2/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Start _get_guest_xml network_info=[{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNmcLnKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed764905-0085-48a3-ab16-0b108bedf0b2', 'attached_at': '', 'detached_at': '', 'volume_id': '2380b941-e961-4298-9cb7-586dbcfd2600', 'serial': '2380b941-e961-4298-9cb7-586dbcfd2600'}, 'disk_bus': 'virtio', 'attachment_id': 'a2f50fd5-fd72-4fb5-b993-1bbfefd60915', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:28:24 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:28:24 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNmcLnKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:28:24 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:28:24 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:28:24 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b0cff7-8c09-4f15-a9b7-6775e0e3d5ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:28:24 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[584759f2-3c84-46b3-8f07-e065d57b54e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600] added
Oct 30 09:28:24 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84617af5-2fdc-4450-9f52-452bc6db53f3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b4293d-e011-4597-8baf-1aee80490a61]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TNmcLnKQ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TNmcLnKQ" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[96264fea-ef34-42a6-92aa-aab8244ff0f0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TNmcLnKQ'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:25 user nova-compute[75017]: INFO nova.compute.manager [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] [instance: 28c7433c-4edd-4d5b-8d9c-68308998a508] Took 1.42 seconds to detach 1 volumes for instance.
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9446b908-bec0-4513-b32c-3befa2dfb1d4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:25 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:28:25 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7884MB free_disk=25.212371826171875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[61100106-a012-4626-9767-7db83b484a65]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a9d05c-acf9-4e71-9fb8-0bf798c605bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260]
Oct 30 09:28:25 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260] successful.
Oct 30 09:28:25 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c8335-8dbe-40c3-8725-ce8815c3559a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacecbd0-f9e6-4fa0-8f53-d44695ec514d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:28:25 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.789s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance e44fccb6-efe6-461a-91d0-bf1628183258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 28c7433c-4edd-4d5b-8d9c-68308998a508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1af08de5-92f6-44fc-aa50-0130c5068105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7f87386d-6a8e-4095-8ef5-405810b32730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance ed764905-0085-48a3-ab16-0b108bedf0b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa7b990-cc30-4386-8f14-f68f36aca612]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNmcLnKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.545s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:26 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Deleted allocations for instance 28c7433c-4edd-4d5b-8d9c-68308998a508
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1f740199-3808-4174-9754-a9461292ceb8 tempest-ServerActionsTestOtherB-794901056 tempest-ServerActionsTestOtherB-794901056-project-member] Lock "28c7433c-4edd-4d5b-8d9c-68308998a508" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.901s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.840s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] <== connect_volume: return (1842ms) {'type': 'block', 'scsi_wwn': '23965353936326265', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965353936326265', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1247832894',display_name='tempest-TestShelveInstance-server-1247832894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1247832894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH8t7GCNbcPfamzUk2HB8C3+7YghSSRH7vosrDgdDKcel1cb5Bm2LcgI6C6JLt7egD8a9FPQj+2T/hKfoDX8+HBuX5kTKPTyCI6QRkOalZnFz/WGuWlKVV4gByFM0wsgA==',key_name='tempest-TestShelveInstance-1640079032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97e979003a534f9f844a4c60ae72c6b1',ramdisk_id='',reservation_id='r-pl2apff0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-251967741',owner_user_name='tempest-TestShelveInstance-251967741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:28:01Z,user_data=None,user_id='eb0397935e524c6c9da95caa125a1627',uuid=ed764905-0085-48a3-ab16-0b108bedf0b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converting VIF {"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.objects.instance [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lazy-loading 'pci_devices' on Instance uuid ed764905-0085-48a3-ab16-0b108bedf0b2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:28:26 user nova-compute[75017]:   <uuid>ed764905-0085-48a3-ab16-0b108bedf0b2</uuid>
Oct 30 09:28:26 user nova-compute[75017]:   <name>instance-00000022</name>
Oct 30 09:28:26 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:28:26 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:28:26 user nova-compute[75017]:   <metadata>
Oct 30 09:28:26 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:28:26 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:28:26 user nova-compute[75017]:       <nova:name>tempest-TestShelveInstance-server-1247832894</nova:name>
Oct 30 09:28:26 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:28:24</nova:creationTime>
Oct 30 09:28:26 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:28:26 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:28:26 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:28:26 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:28:26 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:28:26 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:28:26 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:28:26 user nova-compute[75017]:       <nova:owner>
Oct 30 09:28:26 user nova-compute[75017]:         <nova:user uuid="eb0397935e524c6c9da95caa125a1627">tempest-TestShelveInstance-251967741-project-member</nova:user>
Oct 30 09:28:26 user nova-compute[75017]:         <nova:project uuid="97e979003a534f9f844a4c60ae72c6b1">tempest-TestShelveInstance-251967741</nova:project>
Oct 30 09:28:26 user nova-compute[75017]:       </nova:owner>
Oct 30 09:28:26 user nova-compute[75017]:       <nova:ports>
Oct 30 09:28:26 user nova-compute[75017]:         <nova:port uuid="0c2e76af-b907-47c9-a852-37fd61d79304">
Oct 30 09:28:26 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 09:28:26 user nova-compute[75017]:         </nova:port>
Oct 30 09:28:26 user nova-compute[75017]:       </nova:ports>
Oct 30 09:28:26 user nova-compute[75017]:     </nova:instance>
Oct 30 09:28:26 user nova-compute[75017]:   </metadata>
Oct 30 09:28:26 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:28:26 user nova-compute[75017]:     <system>
Oct 30 09:28:26 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:28:26 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:28:26 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:28:26 user nova-compute[75017]:       <entry name="serial">ed764905-0085-48a3-ab16-0b108bedf0b2</entry>
Oct 30 09:28:26 user nova-compute[75017]:       <entry name="uuid">ed764905-0085-48a3-ab16-0b108bedf0b2</entry>
Oct 30 09:28:26 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:28:26 user nova-compute[75017]:     </system>
Oct 30 09:28:26 user nova-compute[75017]:   </sysinfo>
Oct 30 09:28:26 user nova-compute[75017]:   <os>
Oct 30 09:28:26 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:28:26 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:28:26 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:28:26 user nova-compute[75017]:   </os>
Oct 30 09:28:26 user nova-compute[75017]:   <features>
Oct 30 09:28:26 user nova-compute[75017]:     <acpi/>
Oct 30 09:28:26 user nova-compute[75017]:     <apic/>
Oct 30 09:28:26 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:28:26 user nova-compute[75017]:   </features>
Oct 30 09:28:26 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:28:26 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:28:26 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:28:26 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:28:26 user nova-compute[75017]:   </clock>
Oct 30 09:28:26 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:28:26 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:28:26 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:28:26 user nova-compute[75017]:   </cpu>
Oct 30 09:28:26 user nova-compute[75017]:   <devices>
Oct 30 09:28:26 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:28:26 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:28:26 user nova-compute[75017]:       <source dev="/dev/sdc"/>
Oct 30 09:28:26 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:28:26 user nova-compute[75017]:       <serial>2380b941-e961-4298-9cb7-586dbcfd2600</serial>
Oct 30 09:28:26 user nova-compute[75017]:     </disk>
Oct 30 09:28:26 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:28:26 user nova-compute[75017]:       <mac address="fa:16:3e:a2:45:25"/>
Oct 30 09:28:26 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:28:26 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:28:26 user nova-compute[75017]:       <target dev="tap0c2e76af-b9"/>
Oct 30 09:28:26 user nova-compute[75017]:     </interface>
Oct 30 09:28:26 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:28:26 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/ed764905-0085-48a3-ab16-0b108bedf0b2/console.log" append="off"/>
Oct 30 09:28:26 user nova-compute[75017]:     </serial>
Oct 30 09:28:26 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:28:26 user nova-compute[75017]:     <video>
Oct 30 09:28:26 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:28:26 user nova-compute[75017]:     </video>
Oct 30 09:28:26 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:28:26 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:28:26 user nova-compute[75017]:     </rng>
Oct 30 09:28:26 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:28:26 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:28:26 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:28:26 user nova-compute[75017]:     </memballoon>
Oct 30 09:28:26 user nova-compute[75017]:   </devices>
Oct 30 09:28:26 user nova-compute[75017]: </domain>
Oct 30 09:28:26 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1247832894',display_name='tempest-TestShelveInstance-server-1247832894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1247832894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH8t7GCNbcPfamzUk2HB8C3+7YghSSRH7vosrDgdDKcel1cb5Bm2LcgI6C6JLt7egD8a9FPQj+2T/hKfoDX8+HBuX5kTKPTyCI6QRkOalZnFz/WGuWlKVV4gByFM0wsgA==',key_name='tempest-TestShelveInstance-1640079032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97e979003a534f9f844a4c60ae72c6b1',ramdisk_id='',reservation_id='r-pl2apff0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-251967741',owner_user_name='tempest-TestShelveInstance-251967741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:28:01Z,user_data=None,user_id='eb0397935e524c6c9da95caa125a1627',uuid=ed764905-0085-48a3-ab16-0b108bedf0b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converting VIF {"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG os_vif [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdea37bf-95fc-5474-ba94-129d3bb5f256', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c2e76af-b9, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c2e76af-b9, col_values=(('qos', UUID('42ee88c9-1f50-4fa7-ba50-5647006d4210')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c2e76af-b9, col_values=(('external_ids', {'iface-id': '0c2e76af-b907-47c9-a852-37fd61d79304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:45:25', 'vm-uuid': 'ed764905-0085-48a3-ab16-0b108bedf0b2'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:26 user nova-compute[75017]: INFO os_vif [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9')
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] No VIF found with MAC fa:16:3e:a2:45:25, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-e44fccb6-efe6-461a-91d0-bf1628183258" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-e44fccb6-efe6-461a-91d0-bf1628183258" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:28:26 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Updating instance_info_cache with network_info: [{"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-e44fccb6-efe6-461a-91d0-bf1628183258" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-4c88877d-133b-4f2b-8fbe-becebf66bfcc req-cb4d0fa9-6d06-46c2-a999-2269e77ec5ec service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4c88877d-133b-4f2b-8fbe-becebf66bfcc req-cb4d0fa9-6d06-46c2-a999-2269e77ec5ec service nova] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4c88877d-133b-4f2b-8fbe-becebf66bfcc req-cb4d0fa9-6d06-46c2-a999-2269e77ec5ec service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4c88877d-133b-4f2b-8fbe-becebf66bfcc req-cb4d0fa9-6d06-46c2-a999-2269e77ec5ec service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-4c88877d-133b-4f2b-8fbe-becebf66bfcc req-cb4d0fa9-6d06-46c2-a999-2269e77ec5ec service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] No waiting events found dispatching network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:28 user nova-compute[75017]: WARNING nova.compute.manager [req-4c88877d-133b-4f2b-8fbe-becebf66bfcc req-cb4d0fa9-6d06-46c2-a999-2269e77ec5ec service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received unexpected event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 for instance with vm_state building and task_state spawning.
Oct 30 09:28:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:28:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Instance spawned successfully.
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing instance network info cache due to event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] Acquiring lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] Acquired lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing network info cache for port 49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:28:30 user nova-compute[75017]: INFO nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Took 5.93 seconds to spawn the instance on the hypervisor.
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:28:30 user nova-compute[75017]: INFO nova.compute.manager [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Took 29.60 seconds to build instance.
Oct 30 09:28:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6367ec22-ce6d-4d2a-86ac-063d584f9bda tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.714s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updated VIF entry in instance network info cache for port 49a85ae2-be3d-4bc7-a478-1e496239897b. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating instance_info_cache with network_info: [{"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] Releasing lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] No waiting events found dispatching network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:30 user nova-compute[75017]: WARNING nova.compute.manager [req-f6e2438c-15f9-4e7e-b573-04fe89555481 req-35416660-d484-4f65-bc61-55666c97ad36 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received unexpected event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 for instance with vm_state building and task_state spawning.
Oct 30 09:28:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:31 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:28:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:28:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-4924f4fc-65ee-4b48-80da-663d1fd0b2f1 req-b2292506-94fe-45e0-bffb-82a1f08b3156 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-4924f4fc-65ee-4b48-80da-663d1fd0b2f1 req-b2292506-94fe-45e0-bffb-82a1f08b3156 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing instance network info cache due to event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:28:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4924f4fc-65ee-4b48-80da-663d1fd0b2f1 req-b2292506-94fe-45e0-bffb-82a1f08b3156 service nova] Acquiring lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:28:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4924f4fc-65ee-4b48-80da-663d1fd0b2f1 req-b2292506-94fe-45e0-bffb-82a1f08b3156 service nova] Acquired lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:28:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-4924f4fc-65ee-4b48-80da-663d1fd0b2f1 req-b2292506-94fe-45e0-bffb-82a1f08b3156 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing network info cache for port 49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:28:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-4924f4fc-65ee-4b48-80da-663d1fd0b2f1 req-b2292506-94fe-45e0-bffb-82a1f08b3156 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updated VIF entry in instance network info cache for port 49a85ae2-be3d-4bc7-a478-1e496239897b. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:28:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-4924f4fc-65ee-4b48-80da-663d1fd0b2f1 req-b2292506-94fe-45e0-bffb-82a1f08b3156 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating instance_info_cache with network_info: [{"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4924f4fc-65ee-4b48-80da-663d1fd0b2f1 req-b2292506-94fe-45e0-bffb-82a1f08b3156 service nova] Releasing lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:28:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:44 user nova-compute[75017]: INFO nova.compute.manager [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Rebooting instance
Oct 30 09:28:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:28:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquired lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:28:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating instance_info_cache with network_info: [{"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Releasing lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-ebed559b-f446-4b7f-9433-5791b8d10106 req-3de8f2a5-cdc2-4944-8821-df1c76ad8e14 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-unplugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ebed559b-f446-4b7f-9433-5791b8d10106 req-3de8f2a5-cdc2-4944-8821-df1c76ad8e14 service nova] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ebed559b-f446-4b7f-9433-5791b8d10106 req-3de8f2a5-cdc2-4944-8821-df1c76ad8e14 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ebed559b-f446-4b7f-9433-5791b8d10106 req-3de8f2a5-cdc2-4944-8821-df1c76ad8e14 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-ebed559b-f446-4b7f-9433-5791b8d10106 req-3de8f2a5-cdc2-4944-8821-df1c76ad8e14 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] No waiting events found dispatching network-vif-unplugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:45 user nova-compute[75017]: WARNING nova.compute.manager [req-ebed559b-f446-4b7f-9433-5791b8d10106 req-3de8f2a5-cdc2-4944-8821-df1c76ad8e14 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received unexpected event network-vif-unplugged-49a85ae2-be3d-4bc7-a478-1e496239897b for instance with vm_state active and task_state reboot_started_hard.
Oct 30 09:28:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:46 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Instance destroyed successfully.
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'resources' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-918079801',display_name='tempest-TestMinimumBasicScenario-server-918079801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-918079801',id=32,image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE24YPg1Ak5sM6DkthwvfZ+/kcYISGoukw1d/2DOcyquVhL+FuJ9OD3LUTJC+QkpUhxic54/g418MtXzzVYvmIamLZrJKXOBTFTJX7khlZcm9GsTu2EiTOYSmU7K2LDA9A==',key_name='tempest-TestMinimumBasicScenario-915519336',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c084ddae4af6448ca2f5b36497ab3a2b',ramdisk_id='',reservation_id='r-0jq7ye0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-692819593',owner_user_name='tempest-TestMinimumBasicScenario-692819593-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:28:45Z,user_data=None,user_id='2ab92f42f38f4dbf8826cae09de164dd',uuid=7f87386d-6a8e-4095-8ef5-405810b32730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converting VIF {"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_vif [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49a85ae2-be, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=904bd484-58ba-4c63-b19a-455f6e18ee27) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:28:46 user nova-compute[75017]: INFO os_vif [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be')
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFOVBohH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:28:46 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be5483-6009-4340-9b6b-e41ceb504db3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:28:46 user nova-compute[75017]: No targets found.
Oct 30 09:28:46 user nova-compute[75017]: iSNS:
Oct 30 09:28:46 user nova-compute[75017]: No targets found.
Oct 30 09:28:46 user nova-compute[75017]: STATIC:
Oct 30 09:28:46 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600
Oct 30 09:28:46 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:28:46 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:28:46 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6
Oct 30 09:28:46 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:28:46 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:28:46 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59
Oct 30 09:28:46 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:28:46 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:28:46 user nova-compute[75017]: FIRMWARE:
Oct 30 09:28:46 user nova-compute[75017]: No targets found.
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:28:46 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:28:46 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacdb5d1-e4ad-42ac-9050-6109079a1c5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b4a25-7f52-4876-9dfe-a975078b8a11]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccc72dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a353797c-95ed-4149-b330-3b277c1c953a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[288a4923-9b81-4da6-bede-756c84c8234e]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52cfdcc-5c59-4f3c-9c05-78f41fd6bdcb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1516bde0-2d49-4d5a-b502-b3dc3f5d761e]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[214ecf37-17c1-44a1-901b-1d9a8c458838]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e429779a-1af5-48a9-8525-969a802914ad]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260]
Oct 30 09:28:46 user nova-compute[75017]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260] successful.
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e5cdb5-c29c-4973-a5f0-c094f3838e25]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] <== disconnect_volume: return (338ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Start _get_guest_xml network_info=[{"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8de72756-a61b-4f24-9830-5cdc0232d561,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': '8de72756-a61b-4f24-9830-5cdc0232d561'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFOVBohH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7f87386d-6a8e-4095-8ef5-405810b32730', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 'serial': 'e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6'}, 'disk_bus': 'virtio', 'attachment_id': '1ee8c57f-d037-4e3e-8d0a-52b745c9b32c', 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:28:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:28:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8de72756-a61b-4f24-9830-5cdc0232d561,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.objects.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Object Instance<7f87386d-6a8e-4095-8ef5-405810b32730> lazy-loaded attributes: resources,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFOVBohH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:28:46 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:28:46 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:28:46 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e570c4-ea4d-49e2-8bbb-c27d8751da90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:28:46 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3b245b-fee1-4e59-8d14-07ce66cd822a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6] added
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[987c8406-9a3c-4f0b-ade2-b588f6d9e37f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d5eac1-f593-4d68-93ce-fbdd702e98a9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFOVBohH {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFOVBohH" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8911db-3f99-437c-8406-3743ae64545b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fFOVBohH'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24623a5-40d2-4c05-b719-f744d0b66e67]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2c8fd2-3e41-4383-829f-4beb2e130bbb]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed87cf5-1d9c-4184-b2ed-2043cf4580c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260]
Oct 30 09:28:46 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260] successful.
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[532a559a-2217-4277-8183-dd9c3bf4d9ab]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56fd95b-2202-4dd5-92b2-d288dede8094]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:28:46 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:28:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[279ab962-bb87-4ec8-b923-02241e40670e]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:28:47 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFOVBohH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23231616634636165', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231616634636165', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-e0be075f-33d8-4a94-b321-6fbfb5796c2e req-872dd499-d8e4-4526-94ef-f8c31e76ff04 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e0be075f-33d8-4a94-b321-6fbfb5796c2e req-872dd499-d8e4-4526-94ef-f8c31e76ff04 service nova] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e0be075f-33d8-4a94-b321-6fbfb5796c2e req-872dd499-d8e4-4526-94ef-f8c31e76ff04 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e0be075f-33d8-4a94-b321-6fbfb5796c2e req-872dd499-d8e4-4526-94ef-f8c31e76ff04 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-e0be075f-33d8-4a94-b321-6fbfb5796c2e req-872dd499-d8e4-4526-94ef-f8c31e76ff04 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] No waiting events found dispatching network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:48 user nova-compute[75017]: WARNING nova.compute.manager [req-e0be075f-33d8-4a94-b321-6fbfb5796c2e req-872dd499-d8e4-4526-94ef-f8c31e76ff04 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received unexpected event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b for instance with vm_state active and task_state reboot_started_hard.
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-918079801',display_name='tempest-TestMinimumBasicScenario-server-918079801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-918079801',id=32,image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE24YPg1Ak5sM6DkthwvfZ+/kcYISGoukw1d/2DOcyquVhL+FuJ9OD3LUTJC+QkpUhxic54/g418MtXzzVYvmIamLZrJKXOBTFTJX7khlZcm9GsTu2EiTOYSmU7K2LDA9A==',key_name='tempest-TestMinimumBasicScenario-915519336',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c084ddae4af6448ca2f5b36497ab3a2b',ramdisk_id='',reservation_id='r-0jq7ye0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-692819593',owner_user_name='tempest-TestMinimumBasicScenario-692819593-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:28:45Z,user_data=None,user_id='2ab92f42f38f4dbf8826cae09de164dd',uuid=7f87386d-6a8e-4095-8ef5-405810b32730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converting VIF {"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.objects.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Object Instance<7f87386d-6a8e-4095-8ef5-405810b32730> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:28:48 user nova-compute[75017]:   <uuid>7f87386d-6a8e-4095-8ef5-405810b32730</uuid>
Oct 30 09:28:48 user nova-compute[75017]:   <name>instance-00000020</name>
Oct 30 09:28:48 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:28:48 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:28:48 user nova-compute[75017]:   <metadata>
Oct 30 09:28:48 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:28:48 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:28:48 user nova-compute[75017]:       <nova:name>tempest-TestMinimumBasicScenario-server-918079801</nova:name>
Oct 30 09:28:48 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:28:46</nova:creationTime>
Oct 30 09:28:48 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:28:48 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:28:48 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:28:48 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:28:48 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:28:48 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:28:48 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:28:48 user nova-compute[75017]:       <nova:owner>
Oct 30 09:28:48 user nova-compute[75017]:         <nova:user uuid="2ab92f42f38f4dbf8826cae09de164dd">tempest-TestMinimumBasicScenario-692819593-project-member</nova:user>
Oct 30 09:28:48 user nova-compute[75017]:         <nova:project uuid="c084ddae4af6448ca2f5b36497ab3a2b">tempest-TestMinimumBasicScenario-692819593</nova:project>
Oct 30 09:28:48 user nova-compute[75017]:       </nova:owner>
Oct 30 09:28:48 user nova-compute[75017]:       <nova:root type="image" uuid="8de72756-a61b-4f24-9830-5cdc0232d561"/>
Oct 30 09:28:48 user nova-compute[75017]:       <nova:ports>
Oct 30 09:28:48 user nova-compute[75017]:         <nova:port uuid="49a85ae2-be3d-4bc7-a478-1e496239897b">
Oct 30 09:28:48 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 09:28:48 user nova-compute[75017]:         </nova:port>
Oct 30 09:28:48 user nova-compute[75017]:       </nova:ports>
Oct 30 09:28:48 user nova-compute[75017]:     </nova:instance>
Oct 30 09:28:48 user nova-compute[75017]:   </metadata>
Oct 30 09:28:48 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:28:48 user nova-compute[75017]:     <system>
Oct 30 09:28:48 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:28:48 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:28:48 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:28:48 user nova-compute[75017]:       <entry name="serial">7f87386d-6a8e-4095-8ef5-405810b32730</entry>
Oct 30 09:28:48 user nova-compute[75017]:       <entry name="uuid">7f87386d-6a8e-4095-8ef5-405810b32730</entry>
Oct 30 09:28:48 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:28:48 user nova-compute[75017]:     </system>
Oct 30 09:28:48 user nova-compute[75017]:   </sysinfo>
Oct 30 09:28:48 user nova-compute[75017]:   <os>
Oct 30 09:28:48 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:28:48 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:28:48 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:28:48 user nova-compute[75017]:   </os>
Oct 30 09:28:48 user nova-compute[75017]:   <features>
Oct 30 09:28:48 user nova-compute[75017]:     <acpi/>
Oct 30 09:28:48 user nova-compute[75017]:     <apic/>
Oct 30 09:28:48 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:28:48 user nova-compute[75017]:   </features>
Oct 30 09:28:48 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:28:48 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:28:48 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:28:48 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:28:48 user nova-compute[75017]:   </clock>
Oct 30 09:28:48 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:28:48 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:28:48 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:28:48 user nova-compute[75017]:   </cpu>
Oct 30 09:28:48 user nova-compute[75017]:   <devices>
Oct 30 09:28:48 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:28:48 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:28:48 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk"/>
Oct 30 09:28:48 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:28:48 user nova-compute[75017]:     </disk>
Oct 30 09:28:48 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:28:48 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:28:48 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:28:48 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:28:48 user nova-compute[75017]:       <serial>e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6</serial>
Oct 30 09:28:48 user nova-compute[75017]:     </disk>
Oct 30 09:28:48 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:28:48 user nova-compute[75017]:       <mac address="fa:16:3e:e8:3b:d2"/>
Oct 30 09:28:48 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:28:48 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:28:48 user nova-compute[75017]:       <target dev="tap49a85ae2-be"/>
Oct 30 09:28:48 user nova-compute[75017]:     </interface>
Oct 30 09:28:48 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:28:48 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/console.log" append="off"/>
Oct 30 09:28:48 user nova-compute[75017]:     </serial>
Oct 30 09:28:48 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:28:48 user nova-compute[75017]:     <video>
Oct 30 09:28:48 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:28:48 user nova-compute[75017]:     </video>
Oct 30 09:28:48 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:28:48 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:28:48 user nova-compute[75017]:     </rng>
Oct 30 09:28:48 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:28:48 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:28:48 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:28:48 user nova-compute[75017]:     </memballoon>
Oct 30 09:28:48 user nova-compute[75017]:   </devices>
Oct 30 09:28:48 user nova-compute[75017]: </domain>
Oct 30 09:28:48 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.objects.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Object Instance<7f87386d-6a8e-4095-8ef5-405810b32730> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5 --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Cannot resize image /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'migration_context' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.objects.base [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Object Instance<7f87386d-6a8e-4095-8ef5-405810b32730> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-918079801',display_name='tempest-TestMinimumBasicScenario-server-918079801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-918079801',id=32,image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE24YPg1Ak5sM6DkthwvfZ+/kcYISGoukw1d/2DOcyquVhL+FuJ9OD3LUTJC+QkpUhxic54/g418MtXzzVYvmIamLZrJKXOBTFTJX7khlZcm9GsTu2EiTOYSmU7K2LDA9A==',key_name='tempest-TestMinimumBasicScenario-915519336',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c084ddae4af6448ca2f5b36497ab3a2b',ramdisk_id='',reservation_id='r-0jq7ye0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-692819593',owner_user_name='tempest-TestMinimumBasicScenario-692819593-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:28:45Z,user_data=None,user_id='2ab92f42f38f4dbf8826cae09de164dd',uuid=7f87386d-6a8e-4095-8ef5-405810b32730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converting VIF {"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG os_vif [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88ca5e64-59f0-51cb-a410-03ed54cc1fca', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49a85ae2-be, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49a85ae2-be, col_values=(('qos', UUID('8f9454f0-9d28-4e5e-af19-e567e0b3db5c')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49a85ae2-be, col_values=(('external_ids', {'iface-id': '49a85ae2-be3d-4bc7-a478-1e496239897b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:3b:d2', 'vm-uuid': '7f87386d-6a8e-4095-8ef5-405810b32730'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:28:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:48 user nova-compute[75017]: INFO os_vif [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be')
Oct 30 09:28:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e1581bf-129b-48b5-abb8-0dbf984275cd req-fdb74085-e439-4224-aef4-26dd33e6d48f service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e1581bf-129b-48b5-abb8-0dbf984275cd req-fdb74085-e439-4224-aef4-26dd33e6d48f service nova] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e1581bf-129b-48b5-abb8-0dbf984275cd req-fdb74085-e439-4224-aef4-26dd33e6d48f service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e1581bf-129b-48b5-abb8-0dbf984275cd req-fdb74085-e439-4224-aef4-26dd33e6d48f service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e1581bf-129b-48b5-abb8-0dbf984275cd req-fdb74085-e439-4224-aef4-26dd33e6d48f service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] No waiting events found dispatching network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:50 user nova-compute[75017]: WARNING nova.compute.manager [req-7e1581bf-129b-48b5-abb8-0dbf984275cd req-fdb74085-e439-4224-aef4-26dd33e6d48f service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received unexpected event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b for instance with vm_state active and task_state reboot_started_hard.
Oct 30 09:28:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-68a4930c-0821-48de-a554-e195d897a2a5 req-76ead515-b20d-469f-ad22-ef9589be3c81 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-68a4930c-0821-48de-a554-e195d897a2a5 req-76ead515-b20d-469f-ad22-ef9589be3c81 service nova] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-68a4930c-0821-48de-a554-e195d897a2a5 req-76ead515-b20d-469f-ad22-ef9589be3c81 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-68a4930c-0821-48de-a554-e195d897a2a5 req-76ead515-b20d-469f-ad22-ef9589be3c81 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-68a4930c-0821-48de-a554-e195d897a2a5 req-76ead515-b20d-469f-ad22-ef9589be3c81 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] No waiting events found dispatching network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:52 user nova-compute[75017]: WARNING nova.compute.manager [req-68a4930c-0821-48de-a554-e195d897a2a5 req-76ead515-b20d-469f-ad22-ef9589be3c81 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received unexpected event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b for instance with vm_state active and task_state reboot_started_hard.
Oct 30 09:28:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:28:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Instance rebooted successfully.
Oct 30 09:28:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:28:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a63f170a-e384-4b34-92c9-173936b51c79 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.614s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "e44fccb6-efe6-461a-91d0-bf1628183258" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "e44fccb6-efe6-461a-91d0-bf1628183258" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:54 user nova-compute[75017]: INFO nova.compute.manager [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Terminating instance
Oct 30 09:28:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-855940c7-92dc-45e0-90c7-a2fb06bb7593 req-cdb138e3-f71e-45c6-aa97-4b6fb44d4fb4 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received event network-vif-unplugged-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-855940c7-92dc-45e0-90c7-a2fb06bb7593 req-cdb138e3-f71e-45c6-aa97-4b6fb44d4fb4 service nova] Acquiring lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-855940c7-92dc-45e0-90c7-a2fb06bb7593 req-cdb138e3-f71e-45c6-aa97-4b6fb44d4fb4 service nova] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-855940c7-92dc-45e0-90c7-a2fb06bb7593 req-cdb138e3-f71e-45c6-aa97-4b6fb44d4fb4 service nova] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-855940c7-92dc-45e0-90c7-a2fb06bb7593 req-cdb138e3-f71e-45c6-aa97-4b6fb44d4fb4 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] No waiting events found dispatching network-vif-unplugged-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-855940c7-92dc-45e0-90c7-a2fb06bb7593 req-cdb138e3-f71e-45c6-aa97-4b6fb44d4fb4 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received event network-vif-unplugged-db61c098-ec9c-4f0c-9673-192f7b917040 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:28:54 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:28:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Instance destroyed successfully.
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.objects.instance [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lazy-loading 'resources' on Instance uuid e44fccb6-efe6-461a-91d0-bf1628183258 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid e44fccb6-efe6-461a-91d0-bf1628183258 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid ed764905-0085-48a3-ab16-0b108bedf0b2 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "c6aae433-005c-4b50-9006-d71bca0f8368" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "e44fccb6-efe6-461a-91d0-bf1628183258" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1635746805',display_name='tempest-ServersNegativeTestJSON-server-1635746805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1635746805',id=21,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98308afa3b794383aca709bceceae3a5',ramdisk_id='',reservation_id='r-bouhyfcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1551770249',owner_user_name='tempest-ServersNegativeTestJSON-1551770249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:19:40Z,user_data=None,user_id='35a9a593584b4225af22375653d9c33a',uuid=e44fccb6-efe6-461a-91d0-bf1628183258,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converting VIF {"id": "db61c098-ec9c-4f0c-9673-192f7b917040", "address": "fa:16:3e:90:14:65", "network": {"id": "564f56a2-f373-481f-87c7-a757f63ccb01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1470587111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98308afa3b794383aca709bceceae3a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb61c098-ec", "ovs_interfaceid": "db61c098-ec9c-4f0c-9673-192f7b917040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:14:65,bridge_name='br-int',has_traffic_filtering=True,id=db61c098-ec9c-4f0c-9673-192f7b917040,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb61c098-ec') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG os_vif [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:14:65,bridge_name='br-int',has_traffic_filtering=True,id=db61c098-ec9c-4f0c-9673-192f7b917040,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb61c098-ec') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb61c098-ec, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6331e0d1-da28-410d-ad3e-69c0c1612537) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:28:55 user nova-compute[75017]: INFO os_vif [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:14:65,bridge_name='br-int',has_traffic_filtering=True,id=db61c098-ec9c-4f0c-9673-192f7b917040,network=Network(564f56a2-f373-481f-87c7-a757f63ccb01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb61c098-ec')
Oct 30 09:28:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Deleting instance files /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258_del
Oct 30 09:28:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Deletion of /opt/stack/data/nova/instances/e44fccb6-efe6-461a-91d0-bf1628183258_del complete
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "c6aae433-005c-4b50-9006-d71bca0f8368" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:55 user nova-compute[75017]: INFO nova.compute.manager [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 30 09:28:55 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:28:55 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:28:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-a20cc070-e613-468f-9360-aaf4cd3bd357 req-9ad255c7-2cc8-4d6d-8845-813134f45289 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received event network-vif-deleted-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:57 user nova-compute[75017]: INFO nova.compute.manager [req-a20cc070-e613-468f-9360-aaf4cd3bd357 req-9ad255c7-2cc8-4d6d-8845-813134f45289 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Neutron deleted interface db61c098-ec9c-4f0c-9673-192f7b917040; detaching it from the instance and deleting it from the info cache
Oct 30 09:28:57 user nova-compute[75017]: DEBUG nova.network.neutron [req-a20cc070-e613-468f-9360-aaf4cd3bd357 req-9ad255c7-2cc8-4d6d-8845-813134f45289 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:57 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Took 1.94 seconds to deallocate network for instance.
Oct 30 09:28:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-a20cc070-e613-468f-9360-aaf4cd3bd357 req-9ad255c7-2cc8-4d6d-8845-813134f45289 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Detach interface failed, port_id=db61c098-ec9c-4f0c-9673-192f7b917040, reason: Instance e44fccb6-efe6-461a-91d0-bf1628183258 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-df9d9d90-024a-42d9-8306-5bccdcdb4467 req-1c70b2f0-57ab-49ef-8613-3dae813424f9 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received event network-vif-plugged-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-df9d9d90-024a-42d9-8306-5bccdcdb4467 req-1c70b2f0-57ab-49ef-8613-3dae813424f9 service nova] Acquiring lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-df9d9d90-024a-42d9-8306-5bccdcdb4467 req-1c70b2f0-57ab-49ef-8613-3dae813424f9 service nova] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-df9d9d90-024a-42d9-8306-5bccdcdb4467 req-1c70b2f0-57ab-49ef-8613-3dae813424f9 service nova] Lock "e44fccb6-efe6-461a-91d0-bf1628183258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG nova.compute.manager [req-df9d9d90-024a-42d9-8306-5bccdcdb4467 req-1c70b2f0-57ab-49ef-8613-3dae813424f9 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] No waiting events found dispatching network-vif-plugged-db61c098-ec9c-4f0c-9673-192f7b917040 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:57 user nova-compute[75017]: WARNING nova.compute.manager [req-df9d9d90-024a-42d9-8306-5bccdcdb4467 req-1c70b2f0-57ab-49ef-8613-3dae813424f9 service nova] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] Received unexpected event network-vif-plugged-db61c098-ec9c-4f0c-9673-192f7b917040 for instance with vm_state deleted and task_state None.
Oct 30 09:28:57 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:57 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Deleted allocations for instance e44fccb6-efe6-461a-91d0-bf1628183258
Oct 30 09:28:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-258ec12a-f106-4abd-9f17-ac55b90901c2 tempest-ServersNegativeTestJSON-1551770249 tempest-ServersNegativeTestJSON-1551770249-project-member] Lock "e44fccb6-efe6-461a-91d0-bf1628183258" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.599s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "e44fccb6-efe6-461a-91d0-bf1628183258" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.769s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:57 user nova-compute[75017]: INFO nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: e44fccb6-efe6-461a-91d0-bf1628183258] During sync_power_state the instance has a pending task (deleting). Skip.
Oct 30 09:28:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "e44fccb6-efe6-461a-91d0-bf1628183258" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:59 user nova-compute[75017]: INFO nova.compute.manager [None req-2c523c12-5b4f-4c77-b18c-f18c2d0dcaa3 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Unrescuing
Oct 30 09:28:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2c523c12-5b4f-4c77-b18c-f18c2d0dcaa3 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2c523c12-5b4f-4c77-b18c-f18c2d0dcaa3 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquired lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2c523c12-5b4f-4c77-b18c-f18c2d0dcaa3 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2c523c12-5b4f-4c77-b18c-f18c2d0dcaa3 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating instance_info_cache with network_info: [{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2c523c12-5b4f-4c77-b18c-f18c2d0dcaa3 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Releasing lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG nova.objects.instance [None req-2c523c12-5b4f-4c77-b18c-f18c2d0dcaa3 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'flavor' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-986405c5-a797-4957-a9c1-1af49c44911b req-46274871-1fd9-424a-8e5c-21e9f28ff4f6 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-unplugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-986405c5-a797-4957-a9c1-1af49c44911b req-46274871-1fd9-424a-8e5c-21e9f28ff4f6 service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-986405c5-a797-4957-a9c1-1af49c44911b req-46274871-1fd9-424a-8e5c-21e9f28ff4f6 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-986405c5-a797-4957-a9c1-1af49c44911b req-46274871-1fd9-424a-8e5c-21e9f28ff4f6 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-986405c5-a797-4957-a9c1-1af49c44911b req-46274871-1fd9-424a-8e5c-21e9f28ff4f6 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-unplugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:28:59 user nova-compute[75017]: WARNING nova.compute.manager [req-986405c5-a797-4957-a9c1-1af49c44911b req-46274871-1fd9-424a-8e5c-21e9f28ff4f6 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-unplugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:28:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:28:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:00 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Instance destroyed successfully.
Oct 30 09:29:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:29:01 user nova-compute[75017]: WARNING nova.compute.manager [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:29:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:01 user nova-compute[75017]: DEBUG nova.compute.manager [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:29:01 user nova-compute[75017]: WARNING nova.compute.manager [req-a6f9efcf-dfa5-4804-9738-9fe94f50f14f req-945f8e84-25fd-4e9c-b203-3d9bef3ab94a service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:29:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2c523c12-5b4f-4c77-b18c-f18c2d0dcaa3 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:29:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-21775517-b8c1-42bd-a6d3-4278e5cdf5bd req-860ef75d-f6da-44c5-98ac-1cdfae4e4b83 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-21775517-b8c1-42bd-a6d3-4278e5cdf5bd req-860ef75d-f6da-44c5-98ac-1cdfae4e4b83 service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-21775517-b8c1-42bd-a6d3-4278e5cdf5bd req-860ef75d-f6da-44c5-98ac-1cdfae4e4b83 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-21775517-b8c1-42bd-a6d3-4278e5cdf5bd req-860ef75d-f6da-44c5-98ac-1cdfae4e4b83 service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-21775517-b8c1-42bd-a6d3-4278e5cdf5bd req-860ef75d-f6da-44c5-98ac-1cdfae4e4b83 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:29:03 user nova-compute[75017]: WARNING nova.compute.manager [req-21775517-b8c1-42bd-a6d3-4278e5cdf5bd req-860ef75d-f6da-44c5-98ac-1cdfae4e4b83 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:29:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-e8092acd-22b0-4b87-adbc-893caec868ed req-6c9e1ff1-27c4-4d49-b63c-e12bce4ad9ae service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-changed-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-e8092acd-22b0-4b87-adbc-893caec868ed req-6c9e1ff1-27c4-4d49-b63c-e12bce4ad9ae service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Refreshing instance network info cache due to event network-changed-5d294406-a8a6-4939-925a-3a5a72dbc2f5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:29:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e8092acd-22b0-4b87-adbc-893caec868ed req-6c9e1ff1-27c4-4d49-b63c-e12bce4ad9ae service nova] Acquiring lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:29:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e8092acd-22b0-4b87-adbc-893caec868ed req-6c9e1ff1-27c4-4d49-b63c-e12bce4ad9ae service nova] Acquired lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:29:07 user nova-compute[75017]: DEBUG nova.network.neutron [req-e8092acd-22b0-4b87-adbc-893caec868ed req-6c9e1ff1-27c4-4d49-b63c-e12bce4ad9ae service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Refreshing network info cache for port 5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:29:07 user nova-compute[75017]: DEBUG nova.network.neutron [req-e8092acd-22b0-4b87-adbc-893caec868ed req-6c9e1ff1-27c4-4d49-b63c-e12bce4ad9ae service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updated VIF entry in instance network info cache for port 5d294406-a8a6-4939-925a-3a5a72dbc2f5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:29:07 user nova-compute[75017]: DEBUG nova.network.neutron [req-e8092acd-22b0-4b87-adbc-893caec868ed req-6c9e1ff1-27c4-4d49-b63c-e12bce4ad9ae service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating instance_info_cache with network_info: [{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:29:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e8092acd-22b0-4b87-adbc-893caec868ed req-6c9e1ff1-27c4-4d49-b63c-e12bce4ad9ae service nova] Releasing lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:29:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:14 user nova-compute[75017]: INFO nova.compute.manager [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Shelving
Oct 30 09:29:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-283b6359-b244-47c4-9c3e-2361d64975ba req-af2e52ae-a5ed-4653-ba40-f29be5f64eca service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-unplugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-283b6359-b244-47c4-9c3e-2361d64975ba req-af2e52ae-a5ed-4653-ba40-f29be5f64eca service nova] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-283b6359-b244-47c4-9c3e-2361d64975ba req-af2e52ae-a5ed-4653-ba40-f29be5f64eca service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-283b6359-b244-47c4-9c3e-2361d64975ba req-af2e52ae-a5ed-4653-ba40-f29be5f64eca service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-283b6359-b244-47c4-9c3e-2361d64975ba req-af2e52ae-a5ed-4653-ba40-f29be5f64eca service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] No waiting events found dispatching network-vif-unplugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:29:14 user nova-compute[75017]: WARNING nova.compute.manager [req-283b6359-b244-47c4-9c3e-2361d64975ba req-af2e52ae-a5ed-4653-ba40-f29be5f64eca service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received unexpected event network-vif-unplugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 for instance with vm_state active and task_state shelving.
Oct 30 09:29:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance destroyed successfully.
Oct 30 09:29:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Beginning cold snapshot process
Oct 30 09:29:15 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:29:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk /opt/stack/data/nova/instances/snapshots/tmphz4mwgnq/a9dbaba6f9b4471eab880b289c71eb24 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk /opt/stack/data/nova/instances/snapshots/tmphz4mwgnq/a9dbaba6f9b4471eab880b289c71eb24" returned: 0 in 0.906s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Snapshot extracted, beginning image upload
Oct 30 09:29:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-b9e6f439-14b5-45f4-8c3f-6c8c3a1a7d53 req-cb12f2be-4a35-4be3-96d1-8c282eceae97 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b9e6f439-14b5-45f4-8c3f-6c8c3a1a7d53 req-cb12f2be-4a35-4be3-96d1-8c282eceae97 service nova] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b9e6f439-14b5-45f4-8c3f-6c8c3a1a7d53 req-cb12f2be-4a35-4be3-96d1-8c282eceae97 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b9e6f439-14b5-45f4-8c3f-6c8c3a1a7d53 req-cb12f2be-4a35-4be3-96d1-8c282eceae97 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-b9e6f439-14b5-45f4-8c3f-6c8c3a1a7d53 req-cb12f2be-4a35-4be3-96d1-8c282eceae97 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] No waiting events found dispatching network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:29:16 user nova-compute[75017]: WARNING nova.compute.manager [req-b9e6f439-14b5-45f4-8c3f-6c8c3a1a7d53 req-cb12f2be-4a35-4be3-96d1-8c282eceae97 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received unexpected event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 for instance with vm_state active and task_state shelving_image_uploading.
Oct 30 09:29:18 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:29:19 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Snapshot image upload complete
Oct 30 09:29:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:29:19 user nova-compute[75017]: INFO nova.compute.manager [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Shelve offloading
Oct 30 09:29:19 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance destroyed successfully.
Oct 30 09:29:19 user nova-compute[75017]: DEBUG nova.compute.manager [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:29:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:29:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquired lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:29:19 user nova-compute[75017]: DEBUG nova.network.neutron [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.network.neutron [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating instance_info_cache with network_info: [{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Releasing lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:29:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance destroyed successfully.
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.objects.instance [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'resources' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1080550565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1080550565',id=33,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUVzmLwbiPXmN9NnSoYBIvC/rFJO8MjqfeNSMbICD5lP9UAYd18J188Rw97Qor3U45PP3nRzLD6zD+fkYyhh9wdWYbFeUn75NgKrAsJb+o4booXMiG+U6LFXn34r9ao1A==',key_name='tempest-keypair-595798195',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:27:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-30au1thv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member',shelved_at='2023-10-30T09:29:19.392057',shelved_host='user',shelved_image_id='e905f6a8-558e-4049-ac7e-7866d31d7c2c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG os_vif [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d294406-a8, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c0fb7e8-e3e2-4a81-995a-fbdbe02fd0c1) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:20 user nova-compute[75017]: INFO os_vif [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8')
Oct 30 09:29:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Deleting instance files /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12_del
Oct 30 09:29:20 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Deletion of /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12_del complete
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3a0e34f-156f-4d65-bd0c-2f49d5394a03 req-1dea29fe-85f1-46e3-a9cb-6d9ab4a779b3 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-changed-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3a0e34f-156f-4d65-bd0c-2f49d5394a03 req-1dea29fe-85f1-46e3-a9cb-6d9ab4a779b3 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Refreshing instance network info cache due to event network-changed-5d294406-a8a6-4939-925a-3a5a72dbc2f5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3a0e34f-156f-4d65-bd0c-2f49d5394a03 req-1dea29fe-85f1-46e3-a9cb-6d9ab4a779b3 service nova] Acquiring lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3a0e34f-156f-4d65-bd0c-2f49d5394a03 req-1dea29fe-85f1-46e3-a9cb-6d9ab4a779b3 service nova] Acquired lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.network.neutron [req-c3a0e34f-156f-4d65-bd0c-2f49d5394a03 req-1dea29fe-85f1-46e3-a9cb-6d9ab4a779b3 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Refreshing network info cache for port 5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:29:20 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Deleted allocations for instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12
Oct 30 09:29:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.objects.instance [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'numa_topology' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:29:20 user nova-compute[75017]: DEBUG nova.objects.base [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12> lazy-loaded attributes: resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG nova.network.neutron [req-c3a0e34f-156f-4d65-bd0c-2f49d5394a03 req-1dea29fe-85f1-46e3-a9cb-6d9ab4a779b3 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updated VIF entry in instance network info cache for port 5d294406-a8a6-4939-925a-3a5a72dbc2f5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG nova.network.neutron [req-c3a0e34f-156f-4d65-bd0c-2f49d5394a03 req-1dea29fe-85f1-46e3-a9cb-6d9ab4a779b3 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating instance_info_cache with network_info: [{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5d294406-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3a0e34f-156f-4d65-bd0c-2f49d5394a03 req-1dea29fe-85f1-46e3-a9cb-6d9ab4a779b3 service nova] Releasing lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-190958de-18a9-47b3-908c-7ef06fa706ab tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.886s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:29:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:29:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:22 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:29:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:23 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:25 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:29:25 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8062MB free_disk=25.217151641845703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1af08de5-92f6-44fc-aa50-0130c5068105 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7f87386d-6a8e-4095-8ef5-405810b32730 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance ed764905-0085-48a3-ab16-0b108bedf0b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:29:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:29:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:29:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:29:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:29:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:29:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:29:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating instance_info_cache with network_info: [{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:29:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:29:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:29:28 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:29:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:29:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "469c433e-a055-4b0d-a7f1-902cd5b13707" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:29:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:35 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:29:35 user nova-compute[75017]: INFO nova.compute.claims [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Claim successful on node user
Oct 30 09:29:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:35 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:29:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:29:36 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:29:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG nova.policy [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd734d26551bc41a585d443a24fac0cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ba6409f82447ba9d0f4f56eef88b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:29:36 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Creating image(s)
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "/opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "/opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "/opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.198s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk 1073741824" returned: 0 in 0.065s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Successfully created port: 201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.240s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:29:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Cannot resize image /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Ensure instance console log exists: /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Successfully updated port: 201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquired lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-65ab2ee9-628e-434d-84f6-becf67812c70 req-d3e67efc-cebc-4666-84e3-63b8ba722343 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received event network-changed-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-65ab2ee9-628e-434d-84f6-becf67812c70 req-d3e67efc-cebc-4666-84e3-63b8ba722343 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Refreshing instance network info cache due to event network-changed-201bcf26-47d6-4832-a32b-1caf784b524c. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-65ab2ee9-628e-434d-84f6-becf67812c70 req-d3e67efc-cebc-4666-84e3-63b8ba722343 service nova] Acquiring lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:29:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updating instance_info_cache with network_info: [{"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Releasing lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Instance network_info: |[{"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-65ab2ee9-628e-434d-84f6-becf67812c70 req-d3e67efc-cebc-4666-84e3-63b8ba722343 service nova] Acquired lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.network.neutron [req-65ab2ee9-628e-434d-84f6-becf67812c70 req-d3e67efc-cebc-4666-84e3-63b8ba722343 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Refreshing network info cache for port 201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Start _get_guest_xml network_info=[{"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:29:38 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:29:38 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1235203410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1235203410',id=35,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-1qgvs0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:29:36Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=469c433e-a055-4b0d-a7f1-902cd5b13707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a6:8f,bridge_name='br-int',has_traffic_filtering=True,id=201bcf26-47d6-4832-a32b-1caf784b524c,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201bcf26-47') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.objects.instance [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'pci_devices' on Instance uuid 469c433e-a055-4b0d-a7f1-902cd5b13707 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:29:38 user nova-compute[75017]:   <uuid>469c433e-a055-4b0d-a7f1-902cd5b13707</uuid>
Oct 30 09:29:38 user nova-compute[75017]:   <name>instance-00000023</name>
Oct 30 09:29:38 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:29:38 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:29:38 user nova-compute[75017]:   <metadata>
Oct 30 09:29:38 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:29:38 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:29:38 user nova-compute[75017]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1235203410</nova:name>
Oct 30 09:29:38 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:29:38</nova:creationTime>
Oct 30 09:29:38 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:29:38 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:29:38 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:29:38 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:29:38 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:29:38 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:29:38 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:29:38 user nova-compute[75017]:       <nova:owner>
Oct 30 09:29:38 user nova-compute[75017]:         <nova:user uuid="d734d26551bc41a585d443a24fac0cd8">tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member</nova:user>
Oct 30 09:29:38 user nova-compute[75017]:         <nova:project uuid="76ba6409f82447ba9d0f4f56eef88b1d">tempest-ServerBootFromVolumeStableRescueTest-1506388181</nova:project>
Oct 30 09:29:38 user nova-compute[75017]:       </nova:owner>
Oct 30 09:29:38 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:29:38 user nova-compute[75017]:       <nova:ports>
Oct 30 09:29:38 user nova-compute[75017]:         <nova:port uuid="201bcf26-47d6-4832-a32b-1caf784b524c">
Oct 30 09:29:38 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 09:29:38 user nova-compute[75017]:         </nova:port>
Oct 30 09:29:38 user nova-compute[75017]:       </nova:ports>
Oct 30 09:29:38 user nova-compute[75017]:     </nova:instance>
Oct 30 09:29:38 user nova-compute[75017]:   </metadata>
Oct 30 09:29:38 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:29:38 user nova-compute[75017]:     <system>
Oct 30 09:29:38 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:29:38 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:29:38 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:29:38 user nova-compute[75017]:       <entry name="serial">469c433e-a055-4b0d-a7f1-902cd5b13707</entry>
Oct 30 09:29:38 user nova-compute[75017]:       <entry name="uuid">469c433e-a055-4b0d-a7f1-902cd5b13707</entry>
Oct 30 09:29:38 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:29:38 user nova-compute[75017]:     </system>
Oct 30 09:29:38 user nova-compute[75017]:   </sysinfo>
Oct 30 09:29:38 user nova-compute[75017]:   <os>
Oct 30 09:29:38 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:29:38 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:29:38 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:29:38 user nova-compute[75017]:   </os>
Oct 30 09:29:38 user nova-compute[75017]:   <features>
Oct 30 09:29:38 user nova-compute[75017]:     <acpi/>
Oct 30 09:29:38 user nova-compute[75017]:     <apic/>
Oct 30 09:29:38 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:29:38 user nova-compute[75017]:   </features>
Oct 30 09:29:38 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:29:38 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:29:38 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:29:38 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:29:38 user nova-compute[75017]:   </clock>
Oct 30 09:29:38 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:29:38 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:29:38 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:29:38 user nova-compute[75017]:   </cpu>
Oct 30 09:29:38 user nova-compute[75017]:   <devices>
Oct 30 09:29:38 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:29:38 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:29:38 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk"/>
Oct 30 09:29:38 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:29:38 user nova-compute[75017]:     </disk>
Oct 30 09:29:38 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:29:38 user nova-compute[75017]:       <mac address="fa:16:3e:35:a6:8f"/>
Oct 30 09:29:38 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:29:38 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:29:38 user nova-compute[75017]:       <target dev="tap201bcf26-47"/>
Oct 30 09:29:38 user nova-compute[75017]:     </interface>
Oct 30 09:29:38 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:29:38 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/console.log" append="off"/>
Oct 30 09:29:38 user nova-compute[75017]:     </serial>
Oct 30 09:29:38 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:29:38 user nova-compute[75017]:     <video>
Oct 30 09:29:38 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:29:38 user nova-compute[75017]:     </video>
Oct 30 09:29:38 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:29:38 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:29:38 user nova-compute[75017]:     </rng>
Oct 30 09:29:38 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:29:38 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:29:38 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:29:38 user nova-compute[75017]:     </memballoon>
Oct 30 09:29:38 user nova-compute[75017]:   </devices>
Oct 30 09:29:38 user nova-compute[75017]: </domain>
Oct 30 09:29:38 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1235203410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1235203410',id=35,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-1qgvs0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:29:36Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=469c433e-a055-4b0d-a7f1-902cd5b13707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a6:8f,bridge_name='br-int',has_traffic_filtering=True,id=201bcf26-47d6-4832-a32b-1caf784b524c,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201bcf26-47') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG os_vif [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a6:8f,bridge_name='br-int',has_traffic_filtering=True,id=201bcf26-47d6-4832-a32b-1caf784b524c,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201bcf26-47') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3791836-c386-5e5c-9c2d-09d77654093a', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap201bcf26-47, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap201bcf26-47, col_values=(('qos', UUID('d5dbe63e-7af4-4007-82b8-020ca56ccaec')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap201bcf26-47, col_values=(('external_ids', {'iface-id': '201bcf26-47d6-4832-a32b-1caf784b524c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:a6:8f', 'vm-uuid': '469c433e-a055-4b0d-a7f1-902cd5b13707'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:38 user nova-compute[75017]: INFO os_vif [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a6:8f,bridge_name='br-int',has_traffic_filtering=True,id=201bcf26-47d6-4832-a32b-1caf784b524c,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201bcf26-47')
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No VIF found with MAC fa:16:3e:35:a6:8f, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.network.neutron [req-65ab2ee9-628e-434d-84f6-becf67812c70 req-d3e67efc-cebc-4666-84e3-63b8ba722343 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updated VIF entry in instance network info cache for port 201bcf26-47d6-4832-a32b-1caf784b524c. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG nova.network.neutron [req-65ab2ee9-628e-434d-84f6-becf67812c70 req-d3e67efc-cebc-4666-84e3-63b8ba722343 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updating instance_info_cache with network_info: [{"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:29:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-65ab2ee9-628e-434d-84f6-becf67812c70 req-d3e67efc-cebc-4666-84e3-63b8ba722343 service nova] Releasing lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:29:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-e3ee546a-39b2-49e8-a786-029ce7b56fdd req-8d44e973-b350-4ca2-b72e-bb80a4022742 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received event network-vif-plugged-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e3ee546a-39b2-49e8-a786-029ce7b56fdd req-8d44e973-b350-4ca2-b72e-bb80a4022742 service nova] Acquiring lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e3ee546a-39b2-49e8-a786-029ce7b56fdd req-8d44e973-b350-4ca2-b72e-bb80a4022742 service nova] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e3ee546a-39b2-49e8-a786-029ce7b56fdd req-8d44e973-b350-4ca2-b72e-bb80a4022742 service nova] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-e3ee546a-39b2-49e8-a786-029ce7b56fdd req-8d44e973-b350-4ca2-b72e-bb80a4022742 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] No waiting events found dispatching network-vif-plugged-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:29:40 user nova-compute[75017]: WARNING nova.compute.manager [req-e3ee546a-39b2-49e8-a786-029ce7b56fdd req-8d44e973-b350-4ca2-b72e-bb80a4022742 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received unexpected event network-vif-plugged-201bcf26-47d6-4832-a32b-1caf784b524c for instance with vm_state building and task_state spawning.
Oct 30 09:29:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-aec9040b-514e-4352-82a3-3e779a412d82 req-3a49ad9c-7017-47c5-a4f1-e797e75e911d service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received event network-vif-plugged-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-aec9040b-514e-4352-82a3-3e779a412d82 req-3a49ad9c-7017-47c5-a4f1-e797e75e911d service nova] Acquiring lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-aec9040b-514e-4352-82a3-3e779a412d82 req-3a49ad9c-7017-47c5-a4f1-e797e75e911d service nova] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-aec9040b-514e-4352-82a3-3e779a412d82 req-3a49ad9c-7017-47c5-a4f1-e797e75e911d service nova] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-aec9040b-514e-4352-82a3-3e779a412d82 req-3a49ad9c-7017-47c5-a4f1-e797e75e911d service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] No waiting events found dispatching network-vif-plugged-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:29:42 user nova-compute[75017]: WARNING nova.compute.manager [req-aec9040b-514e-4352-82a3-3e779a412d82 req-3a49ad9c-7017-47c5-a4f1-e797e75e911d service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received unexpected event network-vif-plugged-201bcf26-47d6-4832-a32b-1caf784b524c for instance with vm_state building and task_state spawning.
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:29:42 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Instance spawned successfully.
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:29:42 user nova-compute[75017]: INFO nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Took 5.98 seconds to spawn the instance on the hypervisor.
Oct 30 09:29:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:29:42 user nova-compute[75017]: INFO nova.compute.manager [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Took 6.74 seconds to build instance.
Oct 30 09:29:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2b820f95-714e-4973-8780-66ada3639bd7 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.884s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG nova.compute.manager [req-faa41f81-e9c2-47e8-bea1-44e898bf7e66 req-65965b7e-4707-4648-8128-091fa0a45be9 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG nova.compute.manager [req-faa41f81-e9c2-47e8-bea1-44e898bf7e66 req-65965b7e-4707-4648-8128-091fa0a45be9 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing instance network info cache due to event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-faa41f81-e9c2-47e8-bea1-44e898bf7e66 req-65965b7e-4707-4648-8128-091fa0a45be9 service nova] Acquiring lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-faa41f81-e9c2-47e8-bea1-44e898bf7e66 req-65965b7e-4707-4648-8128-091fa0a45be9 service nova] Acquired lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-faa41f81-e9c2-47e8-bea1-44e898bf7e66 req-65965b7e-4707-4648-8128-091fa0a45be9 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-faa41f81-e9c2-47e8-bea1-44e898bf7e66 req-65965b7e-4707-4648-8128-091fa0a45be9 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updated VIF entry in instance network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-faa41f81-e9c2-47e8-bea1-44e898bf7e66 req-65965b7e-4707-4648-8128-091fa0a45be9 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-faa41f81-e9c2-47e8-bea1-44e898bf7e66 req-65965b7e-4707-4648-8128-091fa0a45be9 service nova] Releasing lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:53 user nova-compute[75017]: INFO nova.compute.manager [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Shelve offloading
Oct 30 09:29:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-0b104534-3e99-4523-b0b2-9c220195c1eb req-7d80a227-2f69-40fb-8b23-bc13a00e2b10 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-unplugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0b104534-3e99-4523-b0b2-9c220195c1eb req-7d80a227-2f69-40fb-8b23-bc13a00e2b10 service nova] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0b104534-3e99-4523-b0b2-9c220195c1eb req-7d80a227-2f69-40fb-8b23-bc13a00e2b10 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0b104534-3e99-4523-b0b2-9c220195c1eb req-7d80a227-2f69-40fb-8b23-bc13a00e2b10 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-0b104534-3e99-4523-b0b2-9c220195c1eb req-7d80a227-2f69-40fb-8b23-bc13a00e2b10 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] No waiting events found dispatching network-vif-unplugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:29:54 user nova-compute[75017]: WARNING nova.compute.manager [req-0b104534-3e99-4523-b0b2-9c220195c1eb req-7d80a227-2f69-40fb-8b23-bc13a00e2b10 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received unexpected event network-vif-unplugged-0c2e76af-b907-47c9-a852-37fd61d79304 for instance with vm_state active and task_state shelving.
Oct 30 09:29:54 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Instance destroyed successfully.
Oct 30 09:29:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquired lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:29:54 user nova-compute[75017]: DEBUG nova.network.neutron [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:29:55 user nova-compute[75017]: DEBUG nova.network.neutron [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:29:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Releasing lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-7df6004c-75bc-4f2c-8e75-d5354a810e91 req-6e1fb2ce-767c-4d28-a504-e91e790d8fa0 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7df6004c-75bc-4f2c-8e75-d5354a810e91 req-6e1fb2ce-767c-4d28-a504-e91e790d8fa0 service nova] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7df6004c-75bc-4f2c-8e75-d5354a810e91 req-6e1fb2ce-767c-4d28-a504-e91e790d8fa0 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7df6004c-75bc-4f2c-8e75-d5354a810e91 req-6e1fb2ce-767c-4d28-a504-e91e790d8fa0 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-7df6004c-75bc-4f2c-8e75-d5354a810e91 req-6e1fb2ce-767c-4d28-a504-e91e790d8fa0 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] No waiting events found dispatching network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:29:56 user nova-compute[75017]: WARNING nova.compute.manager [req-7df6004c-75bc-4f2c-8e75-d5354a810e91 req-6e1fb2ce-767c-4d28-a504-e91e790d8fa0 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received unexpected event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 for instance with vm_state active and task_state shelving.
Oct 30 09:29:56 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Instance destroyed successfully.
Oct 30 09:29:56 user nova-compute[75017]: DEBUG nova.objects.instance [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lazy-loading 'resources' on Instance uuid ed764905-0085-48a3-ab16-0b108bedf0b2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1247832894',display_name='tempest-TestShelveInstance-server-1247832894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1247832894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH8t7GCNbcPfamzUk2HB8C3+7YghSSRH7vosrDgdDKcel1cb5Bm2LcgI6C6JLt7egD8a9FPQj+2T/hKfoDX8+HBuX5kTKPTyCI6QRkOalZnFz/WGuWlKVV4gByFM0wsgA==',key_name='tempest-TestShelveInstance-1640079032',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97e979003a534f9f844a4c60ae72c6b1',ramdisk_id='',reservation_id='r-pl2apff0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-251967741',owner_user_name='tempest-TestShelveInstance-251967741-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:28:30Z,user_data=None,user_id='eb0397935e524c6c9da95caa125a1627',uuid=ed764905-0085-48a3-ab16-0b108bedf0b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converting VIF {"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_vif [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c2e76af-b9, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42ee88c9-1f50-4fa7-ba50-5647006d4210) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:29:56 user nova-compute[75017]: INFO os_vif [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9')
Oct 30 09:29:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNmcLnKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:29:56 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a7a354-b844-4eb4-a4c6-1c3239f72769]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:29:56 user nova-compute[75017]: No targets found.
Oct 30 09:29:56 user nova-compute[75017]: iSNS:
Oct 30 09:29:56 user nova-compute[75017]: No targets found.
Oct 30 09:29:56 user nova-compute[75017]: STATIC:
Oct 30 09:29:56 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600
Oct 30 09:29:56 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:29:56 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:29:56 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6
Oct 30 09:29:56 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:29:56 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:29:56 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59
Oct 30 09:29:56 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:29:56 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:29:56 user nova-compute[75017]: FIRMWARE:
Oct 30 09:29:56 user nova-compute[75017]: No targets found.
Oct 30 09:29:56 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:29:56 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:29:56 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cee7f1-141d-47b3-93a2-91fbbb66ad25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb903b45-1aac-4029-826f-7137b6a925d8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:29:56 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:29:56 user nova-compute[75017]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:29:56 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:29:56 user nova-compute[75017]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:29:56 user nova-compute[75017]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:29:56 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf04d39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ba8406-bc2f-4388-a79e-380cf6e0c81d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbf633c-763b-4f1c-8a8f-b5de827963f6]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b405ac7-69c6-41a4-81a2-97ac5c72b09d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[685141b4-f3b3-41a8-ab2a-dc9140ca95a2]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6650057-15a0-48a0-83ef-343194835788]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e227811a-d953-49c0-a64e-22d88e306d54]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260]
Oct 30 09:29:56 user nova-compute[75017]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260] successful.
Oct 30 09:29:56 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e822ded-3b05-43ce-b6d9-c01acf898af0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] <== disconnect_volume: return (358ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:29:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:29:56 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Deleting instance files /opt/stack/data/nova/instances/ed764905-0085-48a3-ab16-0b108bedf0b2_del
Oct 30 09:29:56 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Deletion of /opt/stack/data/nova/instances/ed764905-0085-48a3-ab16-0b108bedf0b2_del complete
Oct 30 09:29:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-31180e2c-a3f5-465f-a57b-ed0c3cb2328a req-80281afe-130f-496b-ba63-5f0ded518009 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:29:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-31180e2c-a3f5-465f-a57b-ed0c3cb2328a req-80281afe-130f-496b-ba63-5f0ded518009 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing instance network info cache due to event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:29:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-31180e2c-a3f5-465f-a57b-ed0c3cb2328a req-80281afe-130f-496b-ba63-5f0ded518009 service nova] Acquiring lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:29:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-31180e2c-a3f5-465f-a57b-ed0c3cb2328a req-80281afe-130f-496b-ba63-5f0ded518009 service nova] Acquired lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:29:58 user nova-compute[75017]: DEBUG nova.network.neutron [req-31180e2c-a3f5-465f-a57b-ed0c3cb2328a req-80281afe-130f-496b-ba63-5f0ded518009 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:29:58 user nova-compute[75017]: DEBUG nova.network.neutron [req-31180e2c-a3f5-465f-a57b-ed0c3cb2328a req-80281afe-130f-496b-ba63-5f0ded518009 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updated VIF entry in instance network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:29:58 user nova-compute[75017]: DEBUG nova.network.neutron [req-31180e2c-a3f5-465f-a57b-ed0c3cb2328a req-80281afe-130f-496b-ba63-5f0ded518009 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": null, "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:29:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-31180e2c-a3f5-465f-a57b-ed0c3cb2328a req-80281afe-130f-496b-ba63-5f0ded518009 service nova] Releasing lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:30:00 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Deleted allocations for instance ed764905-0085-48a3-ab16-0b108bedf0b2
Oct 30 09:30:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:00 user nova-compute[75017]: DEBUG nova.objects.instance [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lazy-loading 'numa_topology' on Instance uuid ed764905-0085-48a3-ab16-0b108bedf0b2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:30:00 user nova-compute[75017]: DEBUG nova.objects.base [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Object Instance<ed764905-0085-48a3-ab16-0b108bedf0b2> lazy-loaded attributes: resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:30:00 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:30:00 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:30:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-54a954f9-c43a-43ba-a72f-d2333734e413 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 7.130s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:20 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:30:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:30:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:30:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:30:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:30:21 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:24 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:30:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:27 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:30:27 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8131MB free_disk=25.175514221191406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1af08de5-92f6-44fc-aa50-0130c5068105 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7f87386d-6a8e-4095-8ef5-405810b32730 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:32 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:30:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:30:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:30:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:30:32 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:30:32 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:30:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:33 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updating instance_info_cache with network_info: [{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:30:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:30:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:30:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:30:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:30:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-3a614dad-59d1-4f92-9dd8-cc869aa52075 req-63d5353a-2520-4dca-b9e6-aad5c5aca872 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:30:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-3a614dad-59d1-4f92-9dd8-cc869aa52075 req-63d5353a-2520-4dca-b9e6-aad5c5aca872 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing instance network info cache due to event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:30:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3a614dad-59d1-4f92-9dd8-cc869aa52075 req-63d5353a-2520-4dca-b9e6-aad5c5aca872 service nova] Acquiring lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:30:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3a614dad-59d1-4f92-9dd8-cc869aa52075 req-63d5353a-2520-4dca-b9e6-aad5c5aca872 service nova] Acquired lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:30:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-3a614dad-59d1-4f92-9dd8-cc869aa52075 req-63d5353a-2520-4dca-b9e6-aad5c5aca872 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing network info cache for port 49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.network.neutron [req-3a614dad-59d1-4f92-9dd8-cc869aa52075 req-63d5353a-2520-4dca-b9e6-aad5c5aca872 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updated VIF entry in instance network info cache for port 49a85ae2-be3d-4bc7-a478-1e496239897b. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.network.neutron [req-3a614dad-59d1-4f92-9dd8-cc869aa52075 req-63d5353a-2520-4dca-b9e6-aad5c5aca872 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating instance_info_cache with network_info: [{"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3a614dad-59d1-4f92-9dd8-cc869aa52075 req-63d5353a-2520-4dca-b9e6-aad5c5aca872 service nova] Releasing lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:30:37 user nova-compute[75017]: INFO nova.compute.claims [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Claim successful on node user
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:30:37 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:30:37 user nova-compute[75017]: DEBUG nova.policy [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4829e2b76b044474a226ba8a6a48a393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cb9c81a01a44079a469bb6aea845cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:30:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Creating image(s)
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "/opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "/opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:38 user nova-compute[75017]: INFO nova.compute.manager [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Detaching volume e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:38 user nova-compute[75017]: INFO nova.virt.block_device [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Attempting to driver detach volume e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 from mountpoint /dev/vdb
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk 1073741824" returned: 0 in 0.053s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Attempting to detach device vdb from instance 7f87386d-6a8e-4095-8ef5-405810b32730 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:30:38 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:30:38 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:30:38 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:30:38 user nova-compute[75017]:   <serial>e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6</serial>
Oct 30 09:30:38 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 09:30:38 user nova-compute[75017]: </disk>
Oct 30 09:30:38 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:30:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully detached device vdb from instance 7f87386d-6a8e-4095-8ef5-405810b32730 from the persistent domain config.
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f87386d-6a8e-4095-8ef5-405810b32730 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:30:38 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:30:38 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:30:38 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:30:38 user nova-compute[75017]:   <serial>e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6</serial>
Oct 30 09:30:38 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 09:30:38 user nova-compute[75017]: </disk>
Oct 30 09:30:38 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Successfully created port: 71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-4c8934f6-caee-413b-b7a5-cad482ad80bd req-68c181bd-82ee-41d6-8798-8133b37e58bc service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-4c8934f6-caee-413b-b7a5-cad482ad80bd req-68c181bd-82ee-41d6-8798-8133b37e58bc service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing instance network info cache due to event network-changed-49a85ae2-be3d-4bc7-a478-1e496239897b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4c8934f6-caee-413b-b7a5-cad482ad80bd req-68c181bd-82ee-41d6-8798-8133b37e58bc service nova] Acquiring lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4c8934f6-caee-413b-b7a5-cad482ad80bd req-68c181bd-82ee-41d6-8798-8133b37e58bc service nova] Acquired lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.network.neutron [req-4c8934f6-caee-413b-b7a5-cad482ad80bd req-68c181bd-82ee-41d6-8798-8133b37e58bc service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Refreshing network info cache for port 49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Cannot resize image /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Ensure instance console log exists: /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.neutron [req-4c8934f6-caee-413b-b7a5-cad482ad80bd req-68c181bd-82ee-41d6-8798-8133b37e58bc service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updated VIF entry in instance network info cache for port 49a85ae2-be3d-4bc7-a478-1e496239897b. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.neutron [req-4c8934f6-caee-413b-b7a5-cad482ad80bd req-68c181bd-82ee-41d6-8798-8133b37e58bc service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating instance_info_cache with network_info: [{"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4c8934f6-caee-413b-b7a5-cad482ad80bd req-68c181bd-82ee-41d6-8798-8133b37e58bc service nova] Releasing lock "refresh_cache-7f87386d-6a8e-4095-8ef5-405810b32730" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.neutron [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Successfully updated port: 71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquired lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.neutron [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-24cf9e11-d98e-415e-b620-3394a30a4ad0 req-87f75692-5a27-4928-975c-ad96a4362bee service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received event network-changed-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-24cf9e11-d98e-415e-b620-3394a30a4ad0 req-87f75692-5a27-4928-975c-ad96a4362bee service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Refreshing instance network info cache due to event network-changed-71ea4c82-7685-4478-9800-11fd83be5383. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-24cf9e11-d98e-415e-b620-3394a30a4ad0 req-87f75692-5a27-4928-975c-ad96a4362bee service nova] Acquiring lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.neutron [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.neutron [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updating instance_info_cache with network_info: [{"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Releasing lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Instance network_info: |[{"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-24cf9e11-d98e-415e-b620-3394a30a4ad0 req-87f75692-5a27-4928-975c-ad96a4362bee service nova] Acquired lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.neutron [req-24cf9e11-d98e-415e-b620-3394a30a4ad0 req-87f75692-5a27-4928-975c-ad96a4362bee service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Refreshing network info cache for port 71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Start _get_guest_xml network_info=[{"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:30:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:30:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1564502954',display_name='tempest-TestStampPattern-server-1564502954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1564502954',id=36,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn4YBrWT+oXcMf0FPfsei5t/kRlFe3zwa88mbl5XB02JUbxKsTrVMHZBihz5S+PsRa4KWSStTjiCQfgLkYHyr/M3IBxUs5GEFYj004rG0vhFW1t4jvvI3x4alcHZMrm+A==',key_name='tempest-TestStampPattern-619789116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10cb9c81a01a44079a469bb6aea845cc',ramdisk_id='',reservation_id='r-5mg9ycjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1711313576',owner_user_name='tempest-TestStampPattern-1711313576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:30:38Z,user_data=None,user_id='4829e2b76b044474a226ba8a6a48a393',uuid=bfbdfdec-fa8f-4c30-999b-8975cbfc37ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converting VIF {"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:55:17,bridge_name='br-int',has_traffic_filtering=True,id=71ea4c82-7685-4478-9800-11fd83be5383,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ea4c82-76') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.objects.instance [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'pci_devices' on Instance uuid bfbdfdec-fa8f-4c30-999b-8975cbfc37ef {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:30:39 user nova-compute[75017]:   <uuid>bfbdfdec-fa8f-4c30-999b-8975cbfc37ef</uuid>
Oct 30 09:30:39 user nova-compute[75017]:   <name>instance-00000024</name>
Oct 30 09:30:39 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:30:39 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:30:39 user nova-compute[75017]:   <metadata>
Oct 30 09:30:39 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:30:39 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:30:39 user nova-compute[75017]:       <nova:name>tempest-TestStampPattern-server-1564502954</nova:name>
Oct 30 09:30:39 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:30:39</nova:creationTime>
Oct 30 09:30:39 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:30:39 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:30:39 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:30:39 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:30:39 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:30:39 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:30:39 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:30:39 user nova-compute[75017]:       <nova:owner>
Oct 30 09:30:39 user nova-compute[75017]:         <nova:user uuid="4829e2b76b044474a226ba8a6a48a393">tempest-TestStampPattern-1711313576-project-member</nova:user>
Oct 30 09:30:39 user nova-compute[75017]:         <nova:project uuid="10cb9c81a01a44079a469bb6aea845cc">tempest-TestStampPattern-1711313576</nova:project>
Oct 30 09:30:39 user nova-compute[75017]:       </nova:owner>
Oct 30 09:30:39 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:30:39 user nova-compute[75017]:       <nova:ports>
Oct 30 09:30:39 user nova-compute[75017]:         <nova:port uuid="71ea4c82-7685-4478-9800-11fd83be5383">
Oct 30 09:30:39 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 09:30:39 user nova-compute[75017]:         </nova:port>
Oct 30 09:30:39 user nova-compute[75017]:       </nova:ports>
Oct 30 09:30:39 user nova-compute[75017]:     </nova:instance>
Oct 30 09:30:39 user nova-compute[75017]:   </metadata>
Oct 30 09:30:39 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:30:39 user nova-compute[75017]:     <system>
Oct 30 09:30:39 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:30:39 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:30:39 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:30:39 user nova-compute[75017]:       <entry name="serial">bfbdfdec-fa8f-4c30-999b-8975cbfc37ef</entry>
Oct 30 09:30:39 user nova-compute[75017]:       <entry name="uuid">bfbdfdec-fa8f-4c30-999b-8975cbfc37ef</entry>
Oct 30 09:30:39 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:30:39 user nova-compute[75017]:     </system>
Oct 30 09:30:39 user nova-compute[75017]:   </sysinfo>
Oct 30 09:30:39 user nova-compute[75017]:   <os>
Oct 30 09:30:39 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:30:39 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:30:39 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:30:39 user nova-compute[75017]:   </os>
Oct 30 09:30:39 user nova-compute[75017]:   <features>
Oct 30 09:30:39 user nova-compute[75017]:     <acpi/>
Oct 30 09:30:39 user nova-compute[75017]:     <apic/>
Oct 30 09:30:39 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:30:39 user nova-compute[75017]:   </features>
Oct 30 09:30:39 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:30:39 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:30:39 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:30:39 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:30:39 user nova-compute[75017]:   </clock>
Oct 30 09:30:39 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:30:39 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:30:39 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:30:39 user nova-compute[75017]:   </cpu>
Oct 30 09:30:39 user nova-compute[75017]:   <devices>
Oct 30 09:30:39 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:30:39 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:30:39 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk"/>
Oct 30 09:30:39 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:30:39 user nova-compute[75017]:     </disk>
Oct 30 09:30:39 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:30:39 user nova-compute[75017]:       <mac address="fa:16:3e:e2:55:17"/>
Oct 30 09:30:39 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:30:39 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:30:39 user nova-compute[75017]:       <target dev="tap71ea4c82-76"/>
Oct 30 09:30:39 user nova-compute[75017]:     </interface>
Oct 30 09:30:39 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:30:39 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/console.log" append="off"/>
Oct 30 09:30:39 user nova-compute[75017]:     </serial>
Oct 30 09:30:39 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:30:39 user nova-compute[75017]:     <video>
Oct 30 09:30:39 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:30:39 user nova-compute[75017]:     </video>
Oct 30 09:30:39 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:30:39 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:30:39 user nova-compute[75017]:     </rng>
Oct 30 09:30:39 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:30:39 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:30:39 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:30:39 user nova-compute[75017]:     </memballoon>
Oct 30 09:30:39 user nova-compute[75017]:   </devices>
Oct 30 09:30:39 user nova-compute[75017]: </domain>
Oct 30 09:30:39 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1564502954',display_name='tempest-TestStampPattern-server-1564502954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1564502954',id=36,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn4YBrWT+oXcMf0FPfsei5t/kRlFe3zwa88mbl5XB02JUbxKsTrVMHZBihz5S+PsRa4KWSStTjiCQfgLkYHyr/M3IBxUs5GEFYj004rG0vhFW1t4jvvI3x4alcHZMrm+A==',key_name='tempest-TestStampPattern-619789116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10cb9c81a01a44079a469bb6aea845cc',ramdisk_id='',reservation_id='r-5mg9ycjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1711313576',owner_user_name='tempest-TestStampPattern-1711313576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:30:38Z,user_data=None,user_id='4829e2b76b044474a226ba8a6a48a393',uuid=bfbdfdec-fa8f-4c30-999b-8975cbfc37ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converting VIF {"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:55:17,bridge_name='br-int',has_traffic_filtering=True,id=71ea4c82-7685-4478-9800-11fd83be5383,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ea4c82-76') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG os_vif [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:55:17,bridge_name='br-int',has_traffic_filtering=True,id=71ea4c82-7685-4478-9800-11fd83be5383,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ea4c82-76') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1d24a43-4977-5d50-a740-cb079223880d', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71ea4c82-76, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71ea4c82-76, col_values=(('qos', UUID('1d7cc567-f508-4b8c-8df4-9a075766ee2c')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71ea4c82-76, col_values=(('external_ids', {'iface-id': '71ea4c82-7685-4478-9800-11fd83be5383', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:55:17', 'vm-uuid': 'bfbdfdec-fa8f-4c30-999b-8975cbfc37ef'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:30:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:39 user nova-compute[75017]: INFO os_vif [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:55:17,bridge_name='br-int',has_traffic_filtering=True,id=71ea4c82-7685-4478-9800-11fd83be5383,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ea4c82-76')
Oct 30 09:30:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:30:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No VIF found with MAC fa:16:3e:e2:55:17, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:30:40 user nova-compute[75017]: DEBUG nova.network.neutron [req-24cf9e11-d98e-415e-b620-3394a30a4ad0 req-87f75692-5a27-4928-975c-ad96a4362bee service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updated VIF entry in instance network info cache for port 71ea4c82-7685-4478-9800-11fd83be5383. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:30:40 user nova-compute[75017]: DEBUG nova.network.neutron [req-24cf9e11-d98e-415e-b620-3394a30a4ad0 req-87f75692-5a27-4928-975c-ad96a4362bee service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updating instance_info_cache with network_info: [{"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:30:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-24cf9e11-d98e-415e-b620-3394a30a4ad0 req-87f75692-5a27-4928-975c-ad96a4362bee service nova] Releasing lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:30:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-d3bbb013-a16d-4f42-9989-b0bb17c67f88 req-49f20e23-41cc-4987-b9a0-2972b71e0e01 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received event network-vif-plugged-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:30:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d3bbb013-a16d-4f42-9989-b0bb17c67f88 req-49f20e23-41cc-4987-b9a0-2972b71e0e01 service nova] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d3bbb013-a16d-4f42-9989-b0bb17c67f88 req-49f20e23-41cc-4987-b9a0-2972b71e0e01 service nova] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d3bbb013-a16d-4f42-9989-b0bb17c67f88 req-49f20e23-41cc-4987-b9a0-2972b71e0e01 service nova] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-d3bbb013-a16d-4f42-9989-b0bb17c67f88 req-49f20e23-41cc-4987-b9a0-2972b71e0e01 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] No waiting events found dispatching network-vif-plugged-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:30:41 user nova-compute[75017]: WARNING nova.compute.manager [req-d3bbb013-a16d-4f42-9989-b0bb17c67f88 req-49f20e23-41cc-4987-b9a0-2972b71e0e01 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received unexpected event network-vif-plugged-71ea4c82-7685-4478-9800-11fd83be5383 for instance with vm_state building and task_state spawning.
Oct 30 09:30:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-004cb6e8-19dc-47b1-9129-796eaa88441a req-a4c9c3f8-62c4-4cce-a0da-e4ef66f4b53b service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received event network-vif-plugged-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:30:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-004cb6e8-19dc-47b1-9129-796eaa88441a req-a4c9c3f8-62c4-4cce-a0da-e4ef66f4b53b service nova] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-004cb6e8-19dc-47b1-9129-796eaa88441a req-a4c9c3f8-62c4-4cce-a0da-e4ef66f4b53b service nova] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-004cb6e8-19dc-47b1-9129-796eaa88441a req-a4c9c3f8-62c4-4cce-a0da-e4ef66f4b53b service nova] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-004cb6e8-19dc-47b1-9129-796eaa88441a req-a4c9c3f8-62c4-4cce-a0da-e4ef66f4b53b service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] No waiting events found dispatching network-vif-plugged-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:30:43 user nova-compute[75017]: WARNING nova.compute.manager [req-004cb6e8-19dc-47b1-9129-796eaa88441a req-a4c9c3f8-62c4-4cce-a0da-e4ef66f4b53b service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received unexpected event network-vif-plugged-71ea4c82-7685-4478-9800-11fd83be5383 for instance with vm_state building and task_state spawning.
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:30:44 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Instance spawned successfully.
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:30:44 user nova-compute[75017]: INFO nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Took 6.09 seconds to spawn the instance on the hypervisor.
Oct 30 09:30:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:30:44 user nova-compute[75017]: INFO nova.compute.manager [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Took 6.92 seconds to build instance.
Oct 30 09:30:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-63ebe0a6-bd23-4c92-8405-23c391ded57f tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.034s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:30:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-7f159824-8003-41bd-90b3-bdc741fe4b2d req-fee628bf-fed2-447f-9318-7e6f75ede58f service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-changed-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG nova.compute.manager [req-7f159824-8003-41bd-90b3-bdc741fe4b2d req-fee628bf-fed2-447f-9318-7e6f75ede58f service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Refreshing instance network info cache due to event network-changed-9705cc2d-9b13-4281-ad14-89ecc4a8cb48. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7f159824-8003-41bd-90b3-bdc741fe4b2d req-fee628bf-fed2-447f-9318-7e6f75ede58f service nova] Acquiring lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7f159824-8003-41bd-90b3-bdc741fe4b2d req-fee628bf-fed2-447f-9318-7e6f75ede58f service nova] Acquired lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG nova.network.neutron [req-7f159824-8003-41bd-90b3-bdc741fe4b2d req-fee628bf-fed2-447f-9318-7e6f75ede58f service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Refreshing network info cache for port 9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG nova.network.neutron [req-7f159824-8003-41bd-90b3-bdc741fe4b2d req-fee628bf-fed2-447f-9318-7e6f75ede58f service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updated VIF entry in instance network info cache for port 9705cc2d-9b13-4281-ad14-89ecc4a8cb48. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG nova.network.neutron [req-7f159824-8003-41bd-90b3-bdc741fe4b2d req-fee628bf-fed2-447f-9318-7e6f75ede58f service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating instance_info_cache with network_info: [{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7f159824-8003-41bd-90b3-bdc741fe4b2d req-fee628bf-fed2-447f-9318-7e6f75ede58f service nova] Releasing lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:30:51 user nova-compute[75017]: INFO nova.compute.manager [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Detaching volume cb8bd736-e5f3-427b-9b33-11ca1968da59
Oct 30 09:30:51 user nova-compute[75017]: INFO nova.virt.block_device [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Attempting to driver detach volume cb8bd736-e5f3-427b-9b33-11ca1968da59 from mountpoint /dev/vdb
Oct 30 09:30:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Attempting to detach device vdb from instance 1af08de5-92f6-44fc-aa50-0130c5068105 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:30:51 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:30:51 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:30:51 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:30:51 user nova-compute[75017]:   <serial>cb8bd736-e5f3-427b-9b33-11ca1968da59</serial>
Oct 30 09:30:51 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:30:51 user nova-compute[75017]: </disk>
Oct 30 09:30:51 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:30:51 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Successfully detached device vdb from instance 1af08de5-92f6-44fc-aa50-0130c5068105 from the persistent domain config.
Oct 30 09:30:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1af08de5-92f6-44fc-aa50-0130c5068105 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:30:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:30:51 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:30:51 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:30:51 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:30:51 user nova-compute[75017]:   <serial>cb8bd736-e5f3-427b-9b33-11ca1968da59</serial>
Oct 30 09:30:51 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:30:51 user nova-compute[75017]: </disk>
Oct 30 09:30:51 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:30:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:30:53 user nova-compute[75017]: DEBUG nova.compute.manager [req-6c70dab9-583f-47a3-a058-8e465a997eee req-ee4d5c86-9868-4fcb-bedc-6864963d9168 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-changed-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:30:53 user nova-compute[75017]: DEBUG nova.compute.manager [req-6c70dab9-583f-47a3-a058-8e465a997eee req-ee4d5c86-9868-4fcb-bedc-6864963d9168 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Refreshing instance network info cache due to event network-changed-9705cc2d-9b13-4281-ad14-89ecc4a8cb48. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:30:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6c70dab9-583f-47a3-a058-8e465a997eee req-ee4d5c86-9868-4fcb-bedc-6864963d9168 service nova] Acquiring lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:30:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6c70dab9-583f-47a3-a058-8e465a997eee req-ee4d5c86-9868-4fcb-bedc-6864963d9168 service nova] Acquired lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:30:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-6c70dab9-583f-47a3-a058-8e465a997eee req-ee4d5c86-9868-4fcb-bedc-6864963d9168 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Refreshing network info cache for port 9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:30:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-6c70dab9-583f-47a3-a058-8e465a997eee req-ee4d5c86-9868-4fcb-bedc-6864963d9168 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updated VIF entry in instance network info cache for port 9705cc2d-9b13-4281-ad14-89ecc4a8cb48. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:30:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-6c70dab9-583f-47a3-a058-8e465a997eee req-ee4d5c86-9868-4fcb-bedc-6864963d9168 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating instance_info_cache with network_info: [{"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:30:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6c70dab9-583f-47a3-a058-8e465a997eee req-ee4d5c86-9868-4fcb-bedc-6864963d9168 service nova] Releasing lock "refresh_cache-1af08de5-92f6-44fc-aa50-0130c5068105" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:30:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:30:59 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f87386d-6a8e-4095-8ef5-405810b32730 is timed out.
Oct 30 09:30:59 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully detached device vdb from instance 7f87386d-6a8e-4095-8ef5-405810b32730 from the live domain config.
Oct 30 09:30:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFOVBohH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:30:59 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e374b4-0bc4-4c0f-9d05-2698c16e076e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:30:59 user nova-compute[75017]: No targets found.
Oct 30 09:30:59 user nova-compute[75017]: iSNS:
Oct 30 09:30:59 user nova-compute[75017]: No targets found.
Oct 30 09:30:59 user nova-compute[75017]: STATIC:
Oct 30 09:30:59 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6
Oct 30 09:30:59 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:30:59 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:30:59 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59
Oct 30 09:30:59 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:30:59 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:30:59 user nova-compute[75017]: FIRMWARE:
Oct 30 09:30:59 user nova-compute[75017]: No targets found.
Oct 30 09:30:59 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:30:59 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:30:59 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf25f1e-1bc2-4f74-97b2-07c51ccc7b55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e38608-00c4-4f3b-858a-397af63b9abe]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:30:59 user nova-compute[75017]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:30:59 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:30:59 user nova-compute[75017]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 (non-flash)
Oct 30 09:30:59 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccf23370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c6ac2b-98ae-45ed-a72a-b0ecf1d42e13]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1692025-81d1-48dd-a630-6bdd83aa7c0e]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c0ef18-eff4-4b01-9d2f-29f9b6403f42]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5309cc09-1f67-4c0b-abea-ab007698d234]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5b5137-2573-40e2-a5cc-245e157e91f3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c29d2b-21a3-4836-a753-ca84274728ea]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260]
Oct 30 09:30:59 user nova-compute[75017]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6, portal: 172.16.0.220,3260] successful.
Oct 30 09:30:59 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b6958c-64d1-4ebb-a2e0-fa82fd62c5a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f391e786-976e-4c6a-892c-c142ba04b322]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] <== disconnect_volume: return (276ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:30:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:00 user nova-compute[75017]: DEBUG nova.objects.instance [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'flavor' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6e4b2b59-f6cf-4be4-b540-1a54fcb3688c tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.049s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:07 user nova-compute[75017]: INFO nova.compute.manager [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Unshelving
Oct 30 09:31:07 user nova-compute[75017]: INFO nova.virt.block_device [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Booting with volume d957c5b2-2d55-479b-8f68-94252d3b1115 at /dev/vdc
Oct 30 09:31:07 user nova-compute[75017]: DEBUG os_brick.utils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30942c5-2be7-4fc9-ac58-78611beb7a47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcb0f88-7e62-4f12-9448-99d62c03fe49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[04404d8b-fae2-4e59-8e7e-0f57a9b524b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b627edb-6aa2-4334-b17a-7eb0a88d6e3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:31:07 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:31:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8686454d-60b0-4b8d-8e6f-b99f1077619d]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG os_brick.utils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:31:07 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating existing volume attachment record: e31e3237-ac78-4d0b-803c-9f3df9f99750 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:31:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:12 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1af08de5-92f6-44fc-aa50-0130c5068105 is timed out.
Oct 30 09:31:12 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Successfully detached device vdb from instance 1af08de5-92f6-44fc-aa50-0130c5068105 from the live domain config.
Oct 30 09:31:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyzDkoeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:31:12 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9822fe2-49e9-401b-8caf-b732f28cfef5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:31:12 user nova-compute[75017]: No targets found.
Oct 30 09:31:12 user nova-compute[75017]: iSNS:
Oct 30 09:31:12 user nova-compute[75017]: No targets found.
Oct 30 09:31:12 user nova-compute[75017]: STATIC:
Oct 30 09:31:12 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59
Oct 30 09:31:12 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:31:12 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:31:12 user nova-compute[75017]: FIRMWARE:
Oct 30 09:31:12 user nova-compute[75017]: No targets found.
Oct 30 09:31:12 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:31:12 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:31:12 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4099cf-0b24-4a82-8286-8980c52cf843]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[809baaa6-93f3-4c81-b116-398351af4b6e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:31:12 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 (non-flash)
Oct 30 09:31:12 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf0684700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59'): ({'sdd'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Removing single pathed devices sdd {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbabebe-6906-47ca-b1a5-cdcd0e717afe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe80234e-b8ad-4ea9-956e-d4f743638b5d]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Flushing IO for device /dev/sdd {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36eebf0-a0c6-41b4-bba0-e7308b0b7801]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c09672-49a5-425b-be74-823c31282837]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c9b23-560a-448b-be4f-569c805f2377]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa0959-a40d-4698-a168-3f4c73a0f4dd]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59, portal: 172.16.0.220,3260]
Oct 30 09:31:12 user nova-compute[75017]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59, portal: 172.16.0.220,3260] successful.
Oct 30 09:31:12 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8bd736-e5f3-427b-9b33-11ca1968da59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e4d3fc-99c4-406c-99a1-abd13829391d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] <== disconnect_volume: return (326ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:31:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:31:13 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'flavor' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d0557e0c-99e7-4dcf-9862-60bef2aa40f7 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.011s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:13 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:21 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:31:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:31:23 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:31:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:31:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:31:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:25 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG nova.compute.manager [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:26 user nova-compute[75017]: INFO nova.compute.manager [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] instance snapshotting
Oct 30 09:31:26 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:27 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Beginning live snapshot process
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquiring lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730/disk --force-share --output=json" returned: 0 in 0.494s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json -f qcow2 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:31:27 user nova-compute[75017]: INFO nova.compute.claims [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Claim successful on node user
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json -f qcow2 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe8sptzeu/3977426f1ece452d86d0573c5c39067c.delta 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe8sptzeu/3977426f1ece452d86d0573c5c39067c.delta 1073741824" returned: 0 in 0.050s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.376s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'pci_requests' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'numa_topology' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:31:28 user nova-compute[75017]: INFO nova.compute.claims [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Claim successful on node user
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.policy [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79b297f13e3345f8aa3424e8246d7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4156f2f8c4f75b83180c05c156c6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:31:28 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Creating image(s)
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "/opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "/opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Successfully created port: 390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75017) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 1.369s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:31:30 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:31:30 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8085MB free_disk=25.133773803710938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.882s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.068s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:30 user nova-compute[75017]: INFO nova.network.neutron [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating port 5d294406-a8a6-4939-925a-3a5a72dbc2f5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.206s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk 1073741824" returned: 0 in 0.067s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 1af08de5-92f6-44fc-aa50-0130c5068105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7f87386d-6a8e-4095-8ef5-405810b32730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (f288afb1-3149-4266-a22d-d1442c72ffe3): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7bd36d83-4656-45b6-a7c8-38fd4dc6132f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75017) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe8sptzeu/3977426f1ece452d86d0573c5c39067c.delta /opt/stack/data/nova/instances/snapshots/tmpe8sptzeu/3977426f1ece452d86d0573c5c39067c {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:30 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Cannot resize image /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Ensure instance console log exists: /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Successfully updated port: 390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquiring lock "refresh_cache-7bd36d83-4656-45b6-a7c8-38fd4dc6132f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquired lock "refresh_cache-7bd36d83-4656-45b6-a7c8-38fd4dc6132f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-45679ae5-9cdc-432f-a9ee-9f675e77356a req-c5d83dd3-580f-4a3a-8f56-04ce63c9765b service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received event network-changed-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-45679ae5-9cdc-432f-a9ee-9f675e77356a req-c5d83dd3-580f-4a3a-8f56-04ce63c9765b service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Refreshing instance network info cache due to event network-changed-390c80e5-138c-4baa-8283-964f0d4758fb. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-45679ae5-9cdc-432f-a9ee-9f675e77356a req-c5d83dd3-580f-4a3a-8f56-04ce63c9765b service nova] Acquiring lock "refresh_cache-7bd36d83-4656-45b6-a7c8-38fd4dc6132f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquired lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.neutron [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-8199b78f-ec59-41b2-a8da-5aa82ec624a6 req-546874ec-3d18-4960-b267-80f91ed2a862 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-changed-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-8199b78f-ec59-41b2-a8da-5aa82ec624a6 req-546874ec-3d18-4960-b267-80f91ed2a862 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Refreshing instance network info cache due to event network-changed-5d294406-a8a6-4939-925a-3a5a72dbc2f5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8199b78f-ec59-41b2-a8da-5aa82ec624a6 req-546874ec-3d18-4960-b267-80f91ed2a862 service nova] Acquiring lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Updating instance_info_cache with network_info: [{"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Releasing lock "refresh_cache-7bd36d83-4656-45b6-a7c8-38fd4dc6132f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Instance network_info: |[{"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-45679ae5-9cdc-432f-a9ee-9f675e77356a req-c5d83dd3-580f-4a3a-8f56-04ce63c9765b service nova] Acquired lock "refresh_cache-7bd36d83-4656-45b6-a7c8-38fd4dc6132f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-45679ae5-9cdc-432f-a9ee-9f675e77356a req-c5d83dd3-580f-4a3a-8f56-04ce63c9765b service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Refreshing network info cache for port 390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Start _get_guest_xml network_info=[{"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:31:31 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:31:31 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1937159920',display_name='tempest-VolumesActionsTest-instance-1937159920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1937159920',id=37,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bf4156f2f8c4f75b83180c05c156c6c',ramdisk_id='',reservation_id='r-jj8wsuc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-828521606',owner_user_name='tempest-VolumesActionsTest-828521606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:31:29Z,user_data=None,user_id='79b297f13e3345f8aa3424e8246d7882',uuid=7bd36d83-4656-45b6-a7c8-38fd4dc6132f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Converting VIF {"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:73:cb,bridge_name='br-int',has_traffic_filtering=True,id=390c80e5-138c-4baa-8283-964f0d4758fb,network=Network(7504972c-3da4-43d4-afe9-d0df8ce3d05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c80e5-13') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bd36d83-4656-45b6-a7c8-38fd4dc6132f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe8sptzeu/3977426f1ece452d86d0573c5c39067c.delta /opt/stack/data/nova/instances/snapshots/tmpe8sptzeu/3977426f1ece452d86d0573c5c39067c" returned: 0 in 0.715s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Snapshot extracted, beginning image upload
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:31:31 user nova-compute[75017]:   <uuid>7bd36d83-4656-45b6-a7c8-38fd4dc6132f</uuid>
Oct 30 09:31:31 user nova-compute[75017]:   <name>instance-00000025</name>
Oct 30 09:31:31 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:31:31 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:31:31 user nova-compute[75017]:   <metadata>
Oct 30 09:31:31 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:31:31 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:31:31 user nova-compute[75017]:       <nova:name>tempest-VolumesActionsTest-instance-1937159920</nova:name>
Oct 30 09:31:31 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:31:31</nova:creationTime>
Oct 30 09:31:31 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:31:31 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:31:31 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:31:31 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:31:31 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:31:31 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:31:31 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:31:31 user nova-compute[75017]:       <nova:owner>
Oct 30 09:31:31 user nova-compute[75017]:         <nova:user uuid="79b297f13e3345f8aa3424e8246d7882">tempest-VolumesActionsTest-828521606-project-member</nova:user>
Oct 30 09:31:31 user nova-compute[75017]:         <nova:project uuid="7bf4156f2f8c4f75b83180c05c156c6c">tempest-VolumesActionsTest-828521606</nova:project>
Oct 30 09:31:31 user nova-compute[75017]:       </nova:owner>
Oct 30 09:31:31 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:31:31 user nova-compute[75017]:       <nova:ports>
Oct 30 09:31:31 user nova-compute[75017]:         <nova:port uuid="390c80e5-138c-4baa-8283-964f0d4758fb">
Oct 30 09:31:31 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 09:31:31 user nova-compute[75017]:         </nova:port>
Oct 30 09:31:31 user nova-compute[75017]:       </nova:ports>
Oct 30 09:31:31 user nova-compute[75017]:     </nova:instance>
Oct 30 09:31:31 user nova-compute[75017]:   </metadata>
Oct 30 09:31:31 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:31:31 user nova-compute[75017]:     <system>
Oct 30 09:31:31 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:31:31 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:31:31 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:31:31 user nova-compute[75017]:       <entry name="serial">7bd36d83-4656-45b6-a7c8-38fd4dc6132f</entry>
Oct 30 09:31:31 user nova-compute[75017]:       <entry name="uuid">7bd36d83-4656-45b6-a7c8-38fd4dc6132f</entry>
Oct 30 09:31:31 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:31:31 user nova-compute[75017]:     </system>
Oct 30 09:31:31 user nova-compute[75017]:   </sysinfo>
Oct 30 09:31:31 user nova-compute[75017]:   <os>
Oct 30 09:31:31 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:31:31 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:31:31 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:31:31 user nova-compute[75017]:   </os>
Oct 30 09:31:31 user nova-compute[75017]:   <features>
Oct 30 09:31:31 user nova-compute[75017]:     <acpi/>
Oct 30 09:31:31 user nova-compute[75017]:     <apic/>
Oct 30 09:31:31 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:31:31 user nova-compute[75017]:   </features>
Oct 30 09:31:31 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:31:31 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:31:31 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:31:31 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:31:31 user nova-compute[75017]:   </clock>
Oct 30 09:31:31 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:31:31 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:31:31 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:31:31 user nova-compute[75017]:   </cpu>
Oct 30 09:31:31 user nova-compute[75017]:   <devices>
Oct 30 09:31:31 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:31:31 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:31:31 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk"/>
Oct 30 09:31:31 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:31:31 user nova-compute[75017]:     </disk>
Oct 30 09:31:31 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:31:31 user nova-compute[75017]:       <mac address="fa:16:3e:88:73:cb"/>
Oct 30 09:31:31 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:31:31 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:31:31 user nova-compute[75017]:       <target dev="tap390c80e5-13"/>
Oct 30 09:31:31 user nova-compute[75017]:     </interface>
Oct 30 09:31:31 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:31:31 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/console.log" append="off"/>
Oct 30 09:31:31 user nova-compute[75017]:     </serial>
Oct 30 09:31:31 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:31:31 user nova-compute[75017]:     <video>
Oct 30 09:31:31 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:31:31 user nova-compute[75017]:     </video>
Oct 30 09:31:31 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:31:31 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:31:31 user nova-compute[75017]:     </rng>
Oct 30 09:31:31 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:31:31 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:31:31 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:31:31 user nova-compute[75017]:     </memballoon>
Oct 30 09:31:31 user nova-compute[75017]:   </devices>
Oct 30 09:31:31 user nova-compute[75017]: </domain>
Oct 30 09:31:31 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1937159920',display_name='tempest-VolumesActionsTest-instance-1937159920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1937159920',id=37,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bf4156f2f8c4f75b83180c05c156c6c',ramdisk_id='',reservation_id='r-jj8wsuc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-828521606',owner_user_name='tempest-VolumesActionsTest-828521606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:31:29Z,user_data=None,user_id='79b297f13e3345f8aa3424e8246d7882',uuid=7bd36d83-4656-45b6-a7c8-38fd4dc6132f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Converting VIF {"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:73:cb,bridge_name='br-int',has_traffic_filtering=True,id=390c80e5-138c-4baa-8283-964f0d4758fb,network=Network(7504972c-3da4-43d4-afe9-d0df8ce3d05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c80e5-13') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG os_vif [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:73:cb,bridge_name='br-int',has_traffic_filtering=True,id=390c80e5-138c-4baa-8283-964f0d4758fb,network=Network(7504972c-3da4-43d4-afe9-d0df8ce3d05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c80e5-13') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '049e8ec2-3e60-5f14-9ed0-334e6d18d574', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap390c80e5-13, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap390c80e5-13, col_values=(('qos', UUID('0fae7e46-f055-4ab2-8178-56f0a24653d4')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap390c80e5-13, col_values=(('external_ids', {'iface-id': '390c80e5-138c-4baa-8283-964f0d4758fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:73:cb', 'vm-uuid': '7bd36d83-4656-45b6-a7c8-38fd4dc6132f'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:31 user nova-compute[75017]: INFO os_vif [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:73:cb,bridge_name='br-int',has_traffic_filtering=True,id=390c80e5-138c-4baa-8283-964f0d4758fb,network=Network(7504972c-3da4-43d4-afe9-d0df8ce3d05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c80e5-13')
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] No VIF found with MAC fa:16:3e:88:73:cb, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.neutron [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating instance_info_cache with network_info: [{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Releasing lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:31:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Creating image(s)
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'trusted_certs' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8199b78f-ec59-41b2-a8da-5aa82ec624a6 req-546874ec-3d18-4960-b267-80f91ed2a862 service nova] Acquired lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-8199b78f-ec59-41b2-a8da-5aa82ec624a6 req-546874ec-3d18-4960-b267-80f91ed2a862 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Refreshing network info cache for port 5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG nova.objects.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "b2464f82ac6bde8cada4da5660f373b8248b890a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "b2464f82ac6bde8cada4da5660f373b8248b890a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-45679ae5-9cdc-432f-a9ee-9f675e77356a req-c5d83dd3-580f-4a3a-8f56-04ce63c9765b service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Updated VIF entry in instance network info cache for port 390c80e5-138c-4baa-8283-964f0d4758fb. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:31:32 user nova-compute[75017]: DEBUG nova.network.neutron [req-45679ae5-9cdc-432f-a9ee-9f675e77356a req-c5d83dd3-580f-4a3a-8f56-04ce63c9765b service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Updating instance_info_cache with network_info: [{"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:31:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-45679ae5-9cdc-432f-a9ee-9f675e77356a req-c5d83dd3-580f-4a3a-8f56-04ce63c9765b service nova] Releasing lock "refresh_cache-7bd36d83-4656-45b6-a7c8-38fd4dc6132f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:31:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a.part --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG nova.virt.images [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] e905f6a8-558e-4049-ac7e-7866d31d7c2c was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a.part /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-d52c25d3-2d5a-4eb0-8382-edcd04e5a61c req-0110a667-44b4-44ca-a0fb-10c473984948 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received event network-vif-plugged-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d52c25d3-2d5a-4eb0-8382-edcd04e5a61c req-0110a667-44b4-44ca-a0fb-10c473984948 service nova] Acquiring lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d52c25d3-2d5a-4eb0-8382-edcd04e5a61c req-0110a667-44b4-44ca-a0fb-10c473984948 service nova] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d52c25d3-2d5a-4eb0-8382-edcd04e5a61c req-0110a667-44b4-44ca-a0fb-10c473984948 service nova] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-d52c25d3-2d5a-4eb0-8382-edcd04e5a61c req-0110a667-44b4-44ca-a0fb-10c473984948 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] No waiting events found dispatching network-vif-plugged-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:31:33 user nova-compute[75017]: WARNING nova.compute.manager [req-d52c25d3-2d5a-4eb0-8382-edcd04e5a61c req-0110a667-44b4-44ca-a0fb-10c473984948 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received unexpected event network-vif-plugged-390c80e5-138c-4baa-8283-964f0d4758fb for instance with vm_state building and task_state spawning.
Oct 30 09:31:33 user nova-compute[75017]: DEBUG nova.network.neutron [req-8199b78f-ec59-41b2-a8da-5aa82ec624a6 req-546874ec-3d18-4960-b267-80f91ed2a862 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updated VIF entry in instance network info cache for port 5d294406-a8a6-4939-925a-3a5a72dbc2f5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG nova.network.neutron [req-8199b78f-ec59-41b2-a8da-5aa82ec624a6 req-546874ec-3d18-4960-b267-80f91ed2a862 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating instance_info_cache with network_info: [{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8199b78f-ec59-41b2-a8da-5aa82ec624a6 req-546874ec-3d18-4960-b267-80f91ed2a862 service nova] Releasing lock "refresh_cache-f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a.part /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a.converted" returned: 0 in 0.565s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "b2464f82ac6bde8cada4da5660f373b8248b890a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.028s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "b2464f82ac6bde8cada4da5660f373b8248b890a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "b2464f82ac6bde8cada4da5660f373b8248b890a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a --force-share --output=json" returned: 0 in 0.248s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a,backing_fmt=raw /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a,backing_fmt=raw /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk 1073741824" returned: 0 in 0.063s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "b2464f82ac6bde8cada4da5660f373b8248b890a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'migration_context' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG nova.objects.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:31:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Rebasing disk image.
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 -F raw /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Snapshot image upload complete
Oct 30 09:31:35 user nova-compute[75017]: INFO nova.compute.manager [None req-d4d023a0-6a98-4709-b909-f15c0081b54e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Took 8.58 seconds to snapshot the instance on the hypervisor.
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-46699266-0431-4ea6-a969-8d9fca148b85 req-914512f0-8b5b-4a2f-98ed-f51770e4f937 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received event network-vif-plugged-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-46699266-0431-4ea6-a969-8d9fca148b85 req-914512f0-8b5b-4a2f-98ed-f51770e4f937 service nova] Acquiring lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-46699266-0431-4ea6-a969-8d9fca148b85 req-914512f0-8b5b-4a2f-98ed-f51770e4f937 service nova] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-46699266-0431-4ea6-a969-8d9fca148b85 req-914512f0-8b5b-4a2f-98ed-f51770e4f937 service nova] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-46699266-0431-4ea6-a969-8d9fca148b85 req-914512f0-8b5b-4a2f-98ed-f51770e4f937 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] No waiting events found dispatching network-vif-plugged-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:31:35 user nova-compute[75017]: WARNING nova.compute.manager [req-46699266-0431-4ea6-a969-8d9fca148b85 req-914512f0-8b5b-4a2f-98ed-f51770e4f937 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received unexpected event network-vif-plugged-390c80e5-138c-4baa-8283-964f0d4758fb for instance with vm_state building and task_state spawning.
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:31:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Instance spawned successfully.
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:31:35 user nova-compute[75017]: INFO nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Took 6.94 seconds to spawn the instance on the hypervisor.
Oct 30 09:31:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:31:35 user nova-compute[75017]: INFO nova.compute.manager [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Took 8.10 seconds to build instance.
Oct 30 09:31:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b494c62d-9cec-4a54-bf85-b014f428017d tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.257s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 -F raw /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk" returned: 0 in 2.478s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Ensure instance console log exists: /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Start _get_guest_xml network_info=[{"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='af57105f43ba137a8165a1bc8ee97ea0',container_format='bare',created_at=2023-10-30T09:29:14Z,direct_url=<?>,disk_format='qcow2',id=e905f6a8-558e-4049-ac7e-7866d31d7c2c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1080550565-shelved',owner='2d796755933441bfaff1fb821cc2ad9a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T09:29:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYanbjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12', 'attached_at': '', 'detached_at': '', 'volume_id': 'd957c5b2-2d55-479b-8f68-94252d3b1115', 'serial': 'd957c5b2-2d55-479b-8f68-94252d3b1115'}, 'disk_bus': 'virtio', 'attachment_id': 'e31e3237-ac78-4d0b-803c-9f3df9f99750', 'mount_device': '/dev/vdc', 'boot_index': None, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:31:37 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:31:37 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='af57105f43ba137a8165a1bc8ee97ea0',container_format='bare',created_at=2023-10-30T09:29:14Z,direct_url=<?>,disk_format='qcow2',id=e905f6a8-558e-4049-ac7e-7866d31d7c2c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1080550565-shelved',owner='2d796755933441bfaff1fb821cc2ad9a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T09:29:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.objects.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYanbjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:31:37 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:31:37 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:31:37 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b040e473-def3-4c5a-b08e-b3a3412d75d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:31:37 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2036fd32-c2e3-430f-b0c9-7ff49b9c028a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115] added
Oct 30 09:31:37 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b1ecd-303f-494a-87ef-d9c8008c5693]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d4cc31-82f9-4ce9-aa79-bc85c66a1df3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZYanbjp {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updating instance_info_cache with network_info: [{"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZYanbjp" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7db141-1fca-4371-b641-8e9aa1ce1ae9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZYanbjp'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-7ce43b8f-adcf-4650-9b56-8558ca386fe7" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bc8367-aa18-4922-bf55-a919618eeee9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c4121d-8a74-41bf-b1e5-744b09dc9a06]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 09:31:37 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 09:31:37 user nova-compute[75017]:  {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:31:37 user nova-compute[75017]: WARNING os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 09:31:37 user nova-compute[75017]: 
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b10b82-6694-4635-a0c8-fee51b66b3f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115, portal: 172.16.0.220,3260]
Oct 30 09:31:37 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115, portal: 172.16.0.220,3260] successful.
Oct 30 09:31:37 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[076ff208-7ec1-49f9-8be9-80702c274dbe]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb39b5-67ad-47ce-b34d-c2e3312c73c5]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:31:37 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:31:37 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[985a7ed8-9f89-4eab-8db0-0b4bcb4bd811]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:31:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYanbjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:31:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:31:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26163653031653230', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:31:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163653031653230', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:31:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1080550565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1080550565',id=33,image_ref='e905f6a8-558e-4049-ac7e-7866d31d7c2c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-595798195',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:27:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-30au1thv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member',shelved_at='2023-10-30T09:29:19.392057',shelved_host='user',shelved_image_id='e905f6a8-558e-4049-ac7e-7866d31d7c2c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:31:38 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:31:38 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:31:38 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'pci_devices' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:38 user nova-compute[75017]: DEBUG nova.objects.base [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:31:39 user nova-compute[75017]:   <uuid>f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12</uuid>
Oct 30 09:31:39 user nova-compute[75017]:   <name>instance-00000021</name>
Oct 30 09:31:39 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:31:39 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:31:39 user nova-compute[75017]:   <metadata>
Oct 30 09:31:39 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:31:39 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:31:39 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1080550565</nova:name>
Oct 30 09:31:39 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:31:37</nova:creationTime>
Oct 30 09:31:39 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:31:39 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:31:39 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:31:39 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:31:39 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:31:39 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:31:39 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:31:39 user nova-compute[75017]:       <nova:owner>
Oct 30 09:31:39 user nova-compute[75017]:         <nova:user uuid="57fc74a319ac45e4b8f9f14b172d5e17">tempest-AttachVolumeShelveTestJSON-1409612729-project-member</nova:user>
Oct 30 09:31:39 user nova-compute[75017]:         <nova:project uuid="2d796755933441bfaff1fb821cc2ad9a">tempest-AttachVolumeShelveTestJSON-1409612729</nova:project>
Oct 30 09:31:39 user nova-compute[75017]:       </nova:owner>
Oct 30 09:31:39 user nova-compute[75017]:       <nova:root type="image" uuid="e905f6a8-558e-4049-ac7e-7866d31d7c2c"/>
Oct 30 09:31:39 user nova-compute[75017]:       <nova:ports>
Oct 30 09:31:39 user nova-compute[75017]:         <nova:port uuid="5d294406-a8a6-4939-925a-3a5a72dbc2f5">
Oct 30 09:31:39 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 09:31:39 user nova-compute[75017]:         </nova:port>
Oct 30 09:31:39 user nova-compute[75017]:       </nova:ports>
Oct 30 09:31:39 user nova-compute[75017]:     </nova:instance>
Oct 30 09:31:39 user nova-compute[75017]:   </metadata>
Oct 30 09:31:39 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:31:39 user nova-compute[75017]:     <system>
Oct 30 09:31:39 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:31:39 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:31:39 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:31:39 user nova-compute[75017]:       <entry name="serial">f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12</entry>
Oct 30 09:31:39 user nova-compute[75017]:       <entry name="uuid">f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12</entry>
Oct 30 09:31:39 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:31:39 user nova-compute[75017]:     </system>
Oct 30 09:31:39 user nova-compute[75017]:   </sysinfo>
Oct 30 09:31:39 user nova-compute[75017]:   <os>
Oct 30 09:31:39 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:31:39 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:31:39 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:31:39 user nova-compute[75017]:   </os>
Oct 30 09:31:39 user nova-compute[75017]:   <features>
Oct 30 09:31:39 user nova-compute[75017]:     <acpi/>
Oct 30 09:31:39 user nova-compute[75017]:     <apic/>
Oct 30 09:31:39 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:31:39 user nova-compute[75017]:   </features>
Oct 30 09:31:39 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:31:39 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:31:39 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:31:39 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:31:39 user nova-compute[75017]:   </clock>
Oct 30 09:31:39 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:31:39 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:31:39 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:31:39 user nova-compute[75017]:   </cpu>
Oct 30 09:31:39 user nova-compute[75017]:   <devices>
Oct 30 09:31:39 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:31:39 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:31:39 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk"/>
Oct 30 09:31:39 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:31:39 user nova-compute[75017]:     </disk>
Oct 30 09:31:39 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:31:39 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:31:39 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:31:39 user nova-compute[75017]:       <target dev="vdc" bus="virtio"/>
Oct 30 09:31:39 user nova-compute[75017]:       <serial>d957c5b2-2d55-479b-8f68-94252d3b1115</serial>
Oct 30 09:31:39 user nova-compute[75017]:     </disk>
Oct 30 09:31:39 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:31:39 user nova-compute[75017]:       <mac address="fa:16:3e:c5:da:8b"/>
Oct 30 09:31:39 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:31:39 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:31:39 user nova-compute[75017]:       <target dev="tap5d294406-a8"/>
Oct 30 09:31:39 user nova-compute[75017]:     </interface>
Oct 30 09:31:39 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:31:39 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/console.log" append="off"/>
Oct 30 09:31:39 user nova-compute[75017]:     </serial>
Oct 30 09:31:39 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:31:39 user nova-compute[75017]:     <video>
Oct 30 09:31:39 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:31:39 user nova-compute[75017]:     </video>
Oct 30 09:31:39 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:31:39 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:31:39 user nova-compute[75017]:     </rng>
Oct 30 09:31:39 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:31:39 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:31:39 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:31:39 user nova-compute[75017]:     </memballoon>
Oct 30 09:31:39 user nova-compute[75017]:   </devices>
Oct 30 09:31:39 user nova-compute[75017]: </domain>
Oct 30 09:31:39 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1080550565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1080550565',id=33,image_ref='e905f6a8-558e-4049-ac7e-7866d31d7c2c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-595798195',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:27:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-30au1thv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member',shelved_at='2023-10-30T09:29:19.392057',shelved_host='user',shelved_image_id='e905f6a8-558e-4049-ac7e-7866d31d7c2c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG os_vif [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae814f89-e73d-5c71-a123-dd480dcee4a2', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d294406-a8, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d294406-a8, col_values=(('qos', UUID('559054ad-944d-4caf-b408-3361a415c845')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d294406-a8, col_values=(('external_ids', {'iface-id': '5d294406-a8a6-4939-925a-3a5a72dbc2f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:da:8b', 'vm-uuid': 'f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: INFO os_vif [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8')
Oct 30 09:31:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] No VIF found with MAC fa:16:3e:c5:da:8b, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:39 user nova-compute[75017]: INFO nova.compute.manager [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Terminating instance
Oct 30 09:31:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-f3146a82-1341-490a-9c85-5cf020d97d88 req-ec2cf3af-7d7c-4bb8-bbfd-015bd99a70cc service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-unplugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f3146a82-1341-490a-9c85-5cf020d97d88 req-ec2cf3af-7d7c-4bb8-bbfd-015bd99a70cc service nova] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f3146a82-1341-490a-9c85-5cf020d97d88 req-ec2cf3af-7d7c-4bb8-bbfd-015bd99a70cc service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f3146a82-1341-490a-9c85-5cf020d97d88 req-ec2cf3af-7d7c-4bb8-bbfd-015bd99a70cc service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-f3146a82-1341-490a-9c85-5cf020d97d88 req-ec2cf3af-7d7c-4bb8-bbfd-015bd99a70cc service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] No waiting events found dispatching network-vif-unplugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:31:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-f3146a82-1341-490a-9c85-5cf020d97d88 req-ec2cf3af-7d7c-4bb8-bbfd-015bd99a70cc service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-unplugged-49a85ae2-be3d-4bc7-a478-1e496239897b for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:31:41 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Instance destroyed successfully.
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'resources' on Instance uuid 7f87386d-6a8e-4095-8ef5-405810b32730 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-918079801',display_name='tempest-TestMinimumBasicScenario-server-918079801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-918079801',id=32,image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE24YPg1Ak5sM6DkthwvfZ+/kcYISGoukw1d/2DOcyquVhL+FuJ9OD3LUTJC+QkpUhxic54/g418MtXzzVYvmIamLZrJKXOBTFTJX7khlZcm9GsTu2EiTOYSmU7K2LDA9A==',key_name='tempest-TestMinimumBasicScenario-915519336',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c084ddae4af6448ca2f5b36497ab3a2b',ramdisk_id='',reservation_id='r-0jq7ye0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8de72756-a61b-4f24-9830-5cdc0232d561',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-692819593',owner_user_name='tempest-TestMinimumBasicScenario-692819593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:28:53Z,user_data=None,user_id='2ab92f42f38f4dbf8826cae09de164dd',uuid=7f87386d-6a8e-4095-8ef5-405810b32730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converting VIF {"id": "49a85ae2-be3d-4bc7-a478-1e496239897b", "address": "fa:16:3e:e8:3b:d2", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a85ae2-be", "ovs_interfaceid": "49a85ae2-be3d-4bc7-a478-1e496239897b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG os_vif [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49a85ae2-be, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f9454f0-9d28-4e5e-af19-e567e0b3db5c) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: INFO os_vif [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:d2,bridge_name='br-int',has_traffic_filtering=True,id=49a85ae2-be3d-4bc7-a478-1e496239897b,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a85ae2-be')
Oct 30 09:31:41 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Deleting instance files /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730_del
Oct 30 09:31:41 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Deletion of /opt/stack/data/nova/instances/7f87386d-6a8e-4095-8ef5-405810b32730_del complete
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: INFO nova.compute.manager [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Took 1.56 seconds to destroy the instance on the hypervisor.
Oct 30 09:31:41 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-6570e85b-b1cb-4fe3-830a-e28ca48339ee req-6aa0e5a1-7e2a-4e13-a608-1c6131771847 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6570e85b-b1cb-4fe3-830a-e28ca48339ee req-6aa0e5a1-7e2a-4e13-a608-1c6131771847 service nova] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6570e85b-b1cb-4fe3-830a-e28ca48339ee req-6aa0e5a1-7e2a-4e13-a608-1c6131771847 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6570e85b-b1cb-4fe3-830a-e28ca48339ee req-6aa0e5a1-7e2a-4e13-a608-1c6131771847 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-6570e85b-b1cb-4fe3-830a-e28ca48339ee req-6aa0e5a1-7e2a-4e13-a608-1c6131771847 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] No waiting events found dispatching network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:31:41 user nova-compute[75017]: WARNING nova.compute.manager [req-6570e85b-b1cb-4fe3-830a-e28ca48339ee req-6aa0e5a1-7e2a-4e13-a608-1c6131771847 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received unexpected event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-b31c54a1-7c36-4478-b08b-350afeaf4d63 req-7e9f20ee-3437-48e3-9252-62f13627aa99 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-deleted-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:41 user nova-compute[75017]: INFO nova.compute.manager [req-b31c54a1-7c36-4478-b08b-350afeaf4d63 req-7e9f20ee-3437-48e3-9252-62f13627aa99 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Neutron deleted interface 49a85ae2-be3d-4bc7-a478-1e496239897b; detaching it from the instance and deleting it from the info cache
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-b31c54a1-7c36-4478-b08b-350afeaf4d63 req-7e9f20ee-3437-48e3-9252-62f13627aa99 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:31:41 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Took 0.64 seconds to deallocate network for instance.
Oct 30 09:31:41 user nova-compute[75017]: DEBUG nova.compute.manager [req-b31c54a1-7c36-4478-b08b-350afeaf4d63 req-7e9f20ee-3437-48e3-9252-62f13627aa99 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Detach interface failed, port_id=49a85ae2-be3d-4bc7-a478-1e496239897b, reason: Instance 7f87386d-6a8e-4095-8ef5-405810b32730 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-280250be-1d5d-446d-be43-3b7b45fc1709 req-475f57d8-5e32-4fa9-98f9-fa08829f4c67 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-280250be-1d5d-446d-be43-3b7b45fc1709 req-475f57d8-5e32-4fa9-98f9-fa08829f4c67 service nova] Acquiring lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-280250be-1d5d-446d-be43-3b7b45fc1709 req-475f57d8-5e32-4fa9-98f9-fa08829f4c67 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-280250be-1d5d-446d-be43-3b7b45fc1709 req-475f57d8-5e32-4fa9-98f9-fa08829f4c67 service nova] Lock "7f87386d-6a8e-4095-8ef5-405810b32730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-280250be-1d5d-446d-be43-3b7b45fc1709 req-475f57d8-5e32-4fa9-98f9-fa08829f4c67 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] No waiting events found dispatching network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:31:42 user nova-compute[75017]: WARNING nova.compute.manager [req-280250be-1d5d-446d-be43-3b7b45fc1709 req-475f57d8-5e32-4fa9-98f9-fa08829f4c67 service nova] [instance: 7f87386d-6a8e-4095-8ef5-405810b32730] Received unexpected event network-vif-plugged-49a85ae2-be3d-4bc7-a478-1e496239897b for instance with vm_state deleted and task_state None.
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:42 user nova-compute[75017]: INFO nova.compute.manager [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Terminating instance
Oct 30 09:31:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:42 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Deleted allocations for instance 7f87386d-6a8e-4095-8ef5-405810b32730
Oct 30 09:31:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a2739185-5fd3-4c17-9021-d32fbf850bd9 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "7f87386d-6a8e-4095-8ef5-405810b32730" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.896s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:43 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Instance destroyed successfully.
Oct 30 09:31:43 user nova-compute[75017]: DEBUG nova.objects.instance [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'resources' on Instance uuid 1af08de5-92f6-44fc-aa50-0130c5068105 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1156699622',display_name='tempest-ServerRescueNegativeTestJSON-server-1156699622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1156699622',id=31,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiHkKVhHb4iClThemee7bcrZuhx1I0GTqPzFzJCYdqnn/591lr36roMoemqs/9t5XrCdCtjnGaSJ1MgJu8w59mmdzFwcuHWexzVhY1j8x7K4JD2IYmVciSWDWtJo80Riw==',key_name='tempest-keypair-409353962',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:27:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-5u4n2omd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:29:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b340dac0544150bc642f7ecfb07157',uuid=1af08de5-92f6-44fc-aa50-0130c5068105,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "address": "fa:16:3e:1d:c8:de", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9705cc2d-9b", "ovs_interfaceid": "9705cc2d-9b13-4281-ad14-89ecc4a8cb48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c8:de,bridge_name='br-int',has_traffic_filtering=True,id=9705cc2d-9b13-4281-ad14-89ecc4a8cb48,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9705cc2d-9b') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG os_vif [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c8:de,bridge_name='br-int',has_traffic_filtering=True,id=9705cc2d-9b13-4281-ad14-89ecc4a8cb48,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9705cc2d-9b') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9705cc2d-9b, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96a4bc1e-4e5a-4fbb-8ad5-f6b5b4b06eff) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:31:43 user nova-compute[75017]: INFO os_vif [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c8:de,bridge_name='br-int',has_traffic_filtering=True,id=9705cc2d-9b13-4281-ad14-89ecc4a8cb48,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9705cc2d-9b')
Oct 30 09:31:43 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Deleting instance files /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105_del
Oct 30 09:31:43 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Deletion of /opt/stack/data/nova/instances/1af08de5-92f6-44fc-aa50-0130c5068105_del complete
Oct 30 09:31:43 user nova-compute[75017]: INFO nova.compute.manager [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 30 09:31:43 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2aca1ba-cc53-4b01-bff0-124e09c82b02 req-72b9b9a9-4f68-405b-8cdd-1bda8ec69360 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2aca1ba-cc53-4b01-bff0-124e09c82b02 req-72b9b9a9-4f68-405b-8cdd-1bda8ec69360 service nova] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2aca1ba-cc53-4b01-bff0-124e09c82b02 req-72b9b9a9-4f68-405b-8cdd-1bda8ec69360 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e2aca1ba-cc53-4b01-bff0-124e09c82b02 req-72b9b9a9-4f68-405b-8cdd-1bda8ec69360 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-e2aca1ba-cc53-4b01-bff0-124e09c82b02 req-72b9b9a9-4f68-405b-8cdd-1bda8ec69360 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] No waiting events found dispatching network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:31:43 user nova-compute[75017]: WARNING nova.compute.manager [req-e2aca1ba-cc53-4b01-bff0-124e09c82b02 req-72b9b9a9-4f68-405b-8cdd-1bda8ec69360 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received unexpected event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-unplugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-unplugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-unplugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] Acquiring lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] Lock "1af08de5-92f6-44fc-aa50-0130c5068105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] No waiting events found dispatching network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:31:44 user nova-compute[75017]: WARNING nova.compute.manager [req-9be18104-6496-4a59-8fb0-6a5be5675bc9 req-150cfc42-b301-4c51-b9c6-f9ef593b3a7d service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received unexpected event network-vif-plugged-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 for instance with vm_state active and task_state deleting.
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:31:44 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Took 0.76 seconds to deallocate network for instance.
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-a3a26263-8d2b-4afb-9df8-731d7117c172 req-f2758fe6-a605-4799-9522-4615ebd911b0 service nova] [instance: 1af08de5-92f6-44fc-aa50-0130c5068105] Received event network-vif-deleted-9705cc2d-9b13-4281-ad14-89ecc4a8cb48 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:31:44 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance spawned successfully.
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:44 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Deleted allocations for instance 1af08de5-92f6-44fc-aa50-0130c5068105
Oct 30 09:31:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d384224a-2d9c-4c12-a157-f8e904a56dc3 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 37.525s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-88ce21ba-a8fe-4fad-aa69-3cd85a2b50ce tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "1af08de5-92f6-44fc-aa50-0130c5068105" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.610s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:31:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:31:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:31:46 user nova-compute[75017]: INFO nova.compute.manager [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Unshelving
Oct 30 09:31:46 user nova-compute[75017]: INFO nova.virt.block_device [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Booting with volume 2380b941-e961-4298-9cb7-586dbcfd2600 at /dev/vda
Oct 30 09:31:46 user nova-compute[75017]: DEBUG os_brick.utils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:31:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:46 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bf710a-3f2e-48d2-8aa4-f84df264dd7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a12e99-d316-492e-afd7-12f4e94af66f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1dcb12-9975-4423-bf04-01c5c2af37a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ed834c-edb1-4d17-a8b7-c0ac302e5895]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:31:47 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:31:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da70532-22e6-4638-aa31-0da37d8c898b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG os_brick.utils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:31:47 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating existing volume attachment record: 1433f4cb-b9c4-4961-bff8-394bf2a46814 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:31:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:31:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:06 user nova-compute[75017]: DEBUG nova.objects.instance [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lazy-loading 'pci_requests' on Instance uuid ed764905-0085-48a3-ab16-0b108bedf0b2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:32:06 user nova-compute[75017]: DEBUG nova.objects.instance [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lazy-loading 'numa_topology' on Instance uuid ed764905-0085-48a3-ab16-0b108bedf0b2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:32:06 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:32:06 user nova-compute[75017]: INFO nova.compute.claims [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Claim successful on node user
Oct 30 09:32:06 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:32:06 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:32:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:06 user nova-compute[75017]: INFO nova.network.neutron [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating port 0c2e76af-b907-47c9-a852-37fd61d79304 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquired lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.network.neutron [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-f1e35e59-bf4e-4c00-8362-ec092426ab1a req-cd502140-bd0b-4fe9-9556-55f19656cabc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-f1e35e59-bf4e-4c00-8362-ec092426ab1a req-cd502140-bd0b-4fe9-9556-55f19656cabc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing instance network info cache due to event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f1e35e59-bf4e-4c00-8362-ec092426ab1a req-cd502140-bd0b-4fe9-9556-55f19656cabc service nova] Acquiring lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.network.neutron [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Releasing lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:32:07 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Creating image(s)
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Ensure instance console log exists: /opt/stack/data/nova/instances/ed764905-0085-48a3-ab16-0b108bedf0b2/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Start _get_guest_xml network_info=[{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNmcLnKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed764905-0085-48a3-ab16-0b108bedf0b2', 'attached_at': '', 'detached_at': '', 'volume_id': '2380b941-e961-4298-9cb7-586dbcfd2600', 'serial': '2380b941-e961-4298-9cb7-586dbcfd2600'}, 'disk_bus': 'virtio', 'attachment_id': '1433f4cb-b9c4-4961-bff8-394bf2a46814', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f1e35e59-bf4e-4c00-8362-ec092426ab1a req-cd502140-bd0b-4fe9-9556-55f19656cabc service nova] Acquired lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.network.neutron [req-f1e35e59-bf4e-4c00-8362-ec092426ab1a req-cd502140-bd0b-4fe9-9556-55f19656cabc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:32:07 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:32:07 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.objects.instance [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed764905-0085-48a3-ab16-0b108bedf0b2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.objects.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Object Instance<ed764905-0085-48a3-ab16-0b108bedf0b2> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNmcLnKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:32:07 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:32:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:32:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:32:08 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:32:08 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c09b2e-d0c8-42fe-83bf-251caf12cd1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:32:08 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6ae16b-b6a0-46c6-af1e-670ec68ec310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600] added
Oct 30 09:32:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a273fb41-f134-4360-96eb-eb52f0a4ee89]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3144742b-3429-4274-b188-08487a6a9d43]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TNmcLnKQ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TNmcLnKQ" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562da8d-2c03-48a7-9320-08cbf5e2e275]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TNmcLnKQ'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff35ad8-de87-421f-aeec-002efe5dbab5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b683e2-9079-436d-a069-afa3b27319c1]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:32:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:32:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3932b5-a5b0-4a6b-a5c6-c15a930a6d03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260]
Oct 30 09:32:08 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260] successful.
Oct 30 09:32:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b379ffa-4a2d-44c7-951f-9136ff22cf43]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b87036-2d35-4da6-92d4-bbb1e624c8e4]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:32:08 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:32:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:32:08 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:32:08 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f802e0d5-95a9-415a-b89f-41a79a465ff0]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG nova.network.neutron [req-f1e35e59-bf4e-4c00-8362-ec092426ab1a req-cd502140-bd0b-4fe9-9556-55f19656cabc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updated VIF entry in instance network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG nova.network.neutron [req-f1e35e59-bf4e-4c00-8362-ec092426ab1a req-cd502140-bd0b-4fe9-9556-55f19656cabc service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:32:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f1e35e59-bf4e-4c00-8362-ec092426ab1a req-cd502140-bd0b-4fe9-9556-55f19656cabc service nova] Releasing lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNmcLnKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23965353936326265', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965353936326265', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1247832894',display_name='tempest-TestShelveInstance-server-1247832894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1247832894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1640079032',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='97e979003a534f9f844a4c60ae72c6b1',ramdisk_id='',reservation_id='r-pl2apff0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-251967741',owner_user_name='tempest-TestShelveInstance-251967741-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:31:47Z,user_data=None,user_id='eb0397935e524c6c9da95caa125a1627',uuid=ed764905-0085-48a3-ab16-0b108bedf0b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converting VIF {"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.objects.instance [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lazy-loading 'pci_devices' on Instance uuid ed764905-0085-48a3-ab16-0b108bedf0b2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.objects.base [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Object Instance<ed764905-0085-48a3-ab16-0b108bedf0b2> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:32:09 user nova-compute[75017]:   <uuid>ed764905-0085-48a3-ab16-0b108bedf0b2</uuid>
Oct 30 09:32:09 user nova-compute[75017]:   <name>instance-00000022</name>
Oct 30 09:32:09 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:32:09 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:32:09 user nova-compute[75017]:   <metadata>
Oct 30 09:32:09 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:32:09 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:32:09 user nova-compute[75017]:       <nova:name>tempest-TestShelveInstance-server-1247832894</nova:name>
Oct 30 09:32:09 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:32:07</nova:creationTime>
Oct 30 09:32:09 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:32:09 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:32:09 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:32:09 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:32:09 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:32:09 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:32:09 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:32:09 user nova-compute[75017]:       <nova:owner>
Oct 30 09:32:09 user nova-compute[75017]:         <nova:user uuid="eb0397935e524c6c9da95caa125a1627">tempest-TestShelveInstance-251967741-project-member</nova:user>
Oct 30 09:32:09 user nova-compute[75017]:         <nova:project uuid="97e979003a534f9f844a4c60ae72c6b1">tempest-TestShelveInstance-251967741</nova:project>
Oct 30 09:32:09 user nova-compute[75017]:       </nova:owner>
Oct 30 09:32:09 user nova-compute[75017]:       <nova:ports>
Oct 30 09:32:09 user nova-compute[75017]:         <nova:port uuid="0c2e76af-b907-47c9-a852-37fd61d79304">
Oct 30 09:32:09 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 09:32:09 user nova-compute[75017]:         </nova:port>
Oct 30 09:32:09 user nova-compute[75017]:       </nova:ports>
Oct 30 09:32:09 user nova-compute[75017]:     </nova:instance>
Oct 30 09:32:09 user nova-compute[75017]:   </metadata>
Oct 30 09:32:09 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:32:09 user nova-compute[75017]:     <system>
Oct 30 09:32:09 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:32:09 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:32:09 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:32:09 user nova-compute[75017]:       <entry name="serial">ed764905-0085-48a3-ab16-0b108bedf0b2</entry>
Oct 30 09:32:09 user nova-compute[75017]:       <entry name="uuid">ed764905-0085-48a3-ab16-0b108bedf0b2</entry>
Oct 30 09:32:09 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:32:09 user nova-compute[75017]:     </system>
Oct 30 09:32:09 user nova-compute[75017]:   </sysinfo>
Oct 30 09:32:09 user nova-compute[75017]:   <os>
Oct 30 09:32:09 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:32:09 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:32:09 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:32:09 user nova-compute[75017]:   </os>
Oct 30 09:32:09 user nova-compute[75017]:   <features>
Oct 30 09:32:09 user nova-compute[75017]:     <acpi/>
Oct 30 09:32:09 user nova-compute[75017]:     <apic/>
Oct 30 09:32:09 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:32:09 user nova-compute[75017]:   </features>
Oct 30 09:32:09 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:32:09 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:32:09 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:32:09 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:32:09 user nova-compute[75017]:   </clock>
Oct 30 09:32:09 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:32:09 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:32:09 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:32:09 user nova-compute[75017]:   </cpu>
Oct 30 09:32:09 user nova-compute[75017]:   <devices>
Oct 30 09:32:09 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:32:09 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:32:09 user nova-compute[75017]:       <source dev="/dev/sdc"/>
Oct 30 09:32:09 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:32:09 user nova-compute[75017]:       <serial>2380b941-e961-4298-9cb7-586dbcfd2600</serial>
Oct 30 09:32:09 user nova-compute[75017]:     </disk>
Oct 30 09:32:09 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:32:09 user nova-compute[75017]:       <mac address="fa:16:3e:a2:45:25"/>
Oct 30 09:32:09 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:32:09 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:32:09 user nova-compute[75017]:       <target dev="tap0c2e76af-b9"/>
Oct 30 09:32:09 user nova-compute[75017]:     </interface>
Oct 30 09:32:09 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:32:09 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/ed764905-0085-48a3-ab16-0b108bedf0b2/console.log" append="off"/>
Oct 30 09:32:09 user nova-compute[75017]:     </serial>
Oct 30 09:32:09 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:32:09 user nova-compute[75017]:     <video>
Oct 30 09:32:09 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:32:09 user nova-compute[75017]:     </video>
Oct 30 09:32:09 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:32:09 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:32:09 user nova-compute[75017]:     </rng>
Oct 30 09:32:09 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:32:09 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:32:09 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:32:09 user nova-compute[75017]:     </memballoon>
Oct 30 09:32:09 user nova-compute[75017]:   </devices>
Oct 30 09:32:09 user nova-compute[75017]: </domain>
Oct 30 09:32:09 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1247832894',display_name='tempest-TestShelveInstance-server-1247832894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1247832894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1640079032',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='97e979003a534f9f844a4c60ae72c6b1',ramdisk_id='',reservation_id='r-pl2apff0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-251967741',owner_user_name='tempest-TestShelveInstance-251967741-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:31:47Z,user_data=None,user_id='eb0397935e524c6c9da95caa125a1627',uuid=ed764905-0085-48a3-ab16-0b108bedf0b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converting VIF {"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG os_vif [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdea37bf-95fc-5474-ba94-129d3bb5f256', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c2e76af-b9, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c2e76af-b9, col_values=(('qos', UUID('67200110-2b61-4648-b304-b94bcf7276f0')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c2e76af-b9, col_values=(('external_ids', {'iface-id': '0c2e76af-b907-47c9-a852-37fd61d79304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:45:25', 'vm-uuid': 'ed764905-0085-48a3-ab16-0b108bedf0b2'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:09 user nova-compute[75017]: INFO os_vif [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9')
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:32:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] No VIF found with MAC fa:16:3e:a2:45:25, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:32:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-67e8e347-8f93-4092-b4b9-8669c3d31418 req-9c43fa61-fa3d-4b87-8519-85a11305b253 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-67e8e347-8f93-4092-b4b9-8669c3d31418 req-9c43fa61-fa3d-4b87-8519-85a11305b253 service nova] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-67e8e347-8f93-4092-b4b9-8669c3d31418 req-9c43fa61-fa3d-4b87-8519-85a11305b253 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-67e8e347-8f93-4092-b4b9-8669c3d31418 req-9c43fa61-fa3d-4b87-8519-85a11305b253 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-67e8e347-8f93-4092-b4b9-8669c3d31418 req-9c43fa61-fa3d-4b87-8519-85a11305b253 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] No waiting events found dispatching network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:32:11 user nova-compute[75017]: WARNING nova.compute.manager [req-67e8e347-8f93-4092-b4b9-8669c3d31418 req-9c43fa61-fa3d-4b87-8519-85a11305b253 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received unexpected event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 09:32:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:32:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:32:13 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Instance spawned successfully.
Oct 30 09:32:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:32:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93ac1d20-ad40-4dae-938a-535e1c4dd825 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.446s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:13 user nova-compute[75017]: DEBUG nova.compute.manager [req-def4b029-b631-4925-a5fe-2139fe7cd0ae req-338fd093-38df-4988-bb91-060f5caca04d service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:32:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-def4b029-b631-4925-a5fe-2139fe7cd0ae req-338fd093-38df-4988-bb91-060f5caca04d service nova] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-def4b029-b631-4925-a5fe-2139fe7cd0ae req-338fd093-38df-4988-bb91-060f5caca04d service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-def4b029-b631-4925-a5fe-2139fe7cd0ae req-338fd093-38df-4988-bb91-060f5caca04d service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:13 user nova-compute[75017]: DEBUG nova.compute.manager [req-def4b029-b631-4925-a5fe-2139fe7cd0ae req-338fd093-38df-4988-bb91-060f5caca04d service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] No waiting events found dispatching network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:32:13 user nova-compute[75017]: WARNING nova.compute.manager [req-def4b029-b631-4925-a5fe-2139fe7cd0ae req-338fd093-38df-4988-bb91-060f5caca04d service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received unexpected event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 for instance with vm_state active and task_state None.
Oct 30 09:32:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:23 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:27 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:32:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-1b55705f-b1d4-43cc-89cf-f12d6d25e1e4 req-d46f28c5-c464-44ea-aa14-62e205c4a3fe service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received event network-changed-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-1b55705f-b1d4-43cc-89cf-f12d6d25e1e4 req-d46f28c5-c464-44ea-aa14-62e205c4a3fe service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Refreshing instance network info cache due to event network-changed-71ea4c82-7685-4478-9800-11fd83be5383. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1b55705f-b1d4-43cc-89cf-f12d6d25e1e4 req-d46f28c5-c464-44ea-aa14-62e205c4a3fe service nova] Acquiring lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1b55705f-b1d4-43cc-89cf-f12d6d25e1e4 req-d46f28c5-c464-44ea-aa14-62e205c4a3fe service nova] Acquired lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-1b55705f-b1d4-43cc-89cf-f12d6d25e1e4 req-d46f28c5-c464-44ea-aa14-62e205c4a3fe service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Refreshing network info cache for port 71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-1b55705f-b1d4-43cc-89cf-f12d6d25e1e4 req-d46f28c5-c464-44ea-aa14-62e205c4a3fe service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updated VIF entry in instance network info cache for port 71ea4c82-7685-4478-9800-11fd83be5383. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-1b55705f-b1d4-43cc-89cf-f12d6d25e1e4 req-d46f28c5-c464-44ea-aa14-62e205c4a3fe service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updating instance_info_cache with network_info: [{"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1b55705f-b1d4-43cc-89cf-f12d6d25e1e4 req-d46f28c5-c464-44ea-aa14-62e205c4a3fe service nova] Releasing lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:29 user nova-compute[75017]: DEBUG nova.objects.instance [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'flavor' on Instance uuid bfbdfdec-fa8f-4c30-999b-8975cbfc37ef {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:30 user nova-compute[75017]: INFO nova.compute.manager [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Attaching volume 4e363393-eab1-499b-8073-38eda718422c to /dev/vdb
Oct 30 09:32:30 user nova-compute[75017]: DEBUG os_brick.utils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bf16c6-ab06-4787-be9d-438d6ce87677]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef334d7-2f74-410e-a9d2-e560f2e3b480]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b281b5-91e2-45d2-95b1-068fd4907f79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[11311d35-6b5e-41f0-9522-b8c9c1f7ac94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:32:30 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846f3b2-d4e8-48f9-8344-3a160544eb32]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG os_brick.utils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] <== get_connector_properties: return (530ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updating existing volume attachment record: c5860cba-039f-448e-9af1-f5ce1f7e9171 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:32:30 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:32:30 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:32:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7864MB free_disk=25.08325958251953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7bd36d83-4656-45b6-a7c8-38fd4dc6132f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance ed764905-0085-48a3-ab16-0b108bedf0b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:32:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:32:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:32:33 user nova-compute[75017]: INFO nova.compute.claims [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Claim successful on node user
Oct 30 09:32:34 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG nova.network.neutron [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:32:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:32:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG nova.policy [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ab92f42f38f4dbf8826cae09de164dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084ddae4af6448ca2f5b36497ab3a2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:32:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Creating image(s)
Oct 30 09:32:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "/opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "/opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "/opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "cdf7d587091a559f8c44542e06c1a727b6cfaebb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "cdf7d587091a559f8c44542e06c1a727b6cfaebb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG nova.network.neutron [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Successfully created port: e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb.part --force-share --output=json" returned: 0 in 0.222s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG nova.virt.images [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] 29e6f143-eb31-486f-9a12-ca9be6ff8adc was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb.part /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb.part /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb.converted" returned: 0 in 0.568s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "cdf7d587091a559f8c44542e06c1a727b6cfaebb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.485s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Successfully updated port: e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "cdf7d587091a559f8c44542e06c1a727b6cfaebb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "cdf7d587091a559f8c44542e06c1a727b6cfaebb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquired lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-64ee8cf6-01ad-4cd1-8455-fff0fb17b3b2 req-35eb354c-1a25-4623-a566-933c87048e0b service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-64ee8cf6-01ad-4cd1-8455-fff0fb17b3b2 req-35eb354c-1a25-4623-a566-933c87048e0b service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing instance network info cache due to event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-64ee8cf6-01ad-4cd1-8455-fff0fb17b3b2 req-35eb354c-1a25-4623-a566-933c87048e0b service nova] Acquiring lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb,backing_fmt=raw /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb,backing_fmt=raw /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk 1073741824" returned: 0 in 0.071s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "cdf7d587091a559f8c44542e06c1a727b6cfaebb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating instance_info_cache with network_info: [{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Releasing lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Instance network_info: |[{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-64ee8cf6-01ad-4cd1-8455-fff0fb17b3b2 req-35eb354c-1a25-4623-a566-933c87048e0b service nova] Acquired lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-64ee8cf6-01ad-4cd1-8455-fff0fb17b3b2 req-35eb354c-1a25-4623-a566-933c87048e0b service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Cannot resize image /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Ensure instance console log exists: /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Start _get_guest_xml network_info=[{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:32:31Z,direct_url=<?>,disk_format='qcow2',id=29e6f143-eb31-486f-9a12-ca9be6ff8adc,min_disk=0,min_ram=0,name='tempest-scenario-img--2073141232',owner='c084ddae4af6448ca2f5b36497ab3a2b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:32:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': '29e6f143-eb31-486f-9a12-ca9be6ff8adc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:32:36 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:32:36 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:32:31Z,direct_url=<?>,disk_format='qcow2',id=29e6f143-eb31-486f-9a12-ca9be6ff8adc,min_disk=0,min_ram=0,name='tempest-scenario-img--2073141232',owner='c084ddae4af6448ca2f5b36497ab3a2b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:32:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-731552492',display_name='tempest-TestMinimumBasicScenario-server-731552492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-731552492',id=38,image_ref='29e6f143-eb31-486f-9a12-ca9be6ff8adc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN8HM2ppUbiiRNlRtAjnDhOOCi0tEJPMVseOsi6EF3jYCNB+VYo1NN1WFEEbLUjkvhgfd9/jM7gf4Pj6dEvQ6jYnoHhYAHQaeSCGYMz4P4Y25ff+pqH9eGNH2wNR/zXLw==',key_name='tempest-TestMinimumBasicScenario-1041607142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c084ddae4af6448ca2f5b36497ab3a2b',ramdisk_id='',reservation_id='r-06io560d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='29e6f143-eb31-486f-9a12-ca9be6ff8adc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-692819593',owner_user_name='tempest-TestMinimumBasicScenario-692819593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:32:34Z,user_data=None,user_id='2ab92f42f38f4dbf8826cae09de164dd',uuid=85a15494-ab66-4692-949f-be1b0248971c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converting VIF {"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:14:28,bridge_name='br-int',has_traffic_filtering=True,id=e060ba01-5902-47ef-b07a-900fd6891d5c,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060ba01-59') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.objects.instance [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'pci_devices' on Instance uuid 85a15494-ab66-4692-949f-be1b0248971c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:32:36 user nova-compute[75017]:   <uuid>85a15494-ab66-4692-949f-be1b0248971c</uuid>
Oct 30 09:32:36 user nova-compute[75017]:   <name>instance-00000026</name>
Oct 30 09:32:36 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:32:36 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:32:36 user nova-compute[75017]:   <metadata>
Oct 30 09:32:36 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:32:36 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:32:36 user nova-compute[75017]:       <nova:name>tempest-TestMinimumBasicScenario-server-731552492</nova:name>
Oct 30 09:32:36 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:32:36</nova:creationTime>
Oct 30 09:32:36 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:32:36 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:32:36 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:32:36 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:32:36 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:32:36 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:32:36 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:32:36 user nova-compute[75017]:       <nova:owner>
Oct 30 09:32:36 user nova-compute[75017]:         <nova:user uuid="2ab92f42f38f4dbf8826cae09de164dd">tempest-TestMinimumBasicScenario-692819593-project-member</nova:user>
Oct 30 09:32:36 user nova-compute[75017]:         <nova:project uuid="c084ddae4af6448ca2f5b36497ab3a2b">tempest-TestMinimumBasicScenario-692819593</nova:project>
Oct 30 09:32:36 user nova-compute[75017]:       </nova:owner>
Oct 30 09:32:36 user nova-compute[75017]:       <nova:root type="image" uuid="29e6f143-eb31-486f-9a12-ca9be6ff8adc"/>
Oct 30 09:32:36 user nova-compute[75017]:       <nova:ports>
Oct 30 09:32:36 user nova-compute[75017]:         <nova:port uuid="e060ba01-5902-47ef-b07a-900fd6891d5c">
Oct 30 09:32:36 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 09:32:36 user nova-compute[75017]:         </nova:port>
Oct 30 09:32:36 user nova-compute[75017]:       </nova:ports>
Oct 30 09:32:36 user nova-compute[75017]:     </nova:instance>
Oct 30 09:32:36 user nova-compute[75017]:   </metadata>
Oct 30 09:32:36 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:32:36 user nova-compute[75017]:     <system>
Oct 30 09:32:36 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:32:36 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:32:36 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:32:36 user nova-compute[75017]:       <entry name="serial">85a15494-ab66-4692-949f-be1b0248971c</entry>
Oct 30 09:32:36 user nova-compute[75017]:       <entry name="uuid">85a15494-ab66-4692-949f-be1b0248971c</entry>
Oct 30 09:32:36 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:32:36 user nova-compute[75017]:     </system>
Oct 30 09:32:36 user nova-compute[75017]:   </sysinfo>
Oct 30 09:32:36 user nova-compute[75017]:   <os>
Oct 30 09:32:36 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:32:36 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:32:36 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:32:36 user nova-compute[75017]:   </os>
Oct 30 09:32:36 user nova-compute[75017]:   <features>
Oct 30 09:32:36 user nova-compute[75017]:     <acpi/>
Oct 30 09:32:36 user nova-compute[75017]:     <apic/>
Oct 30 09:32:36 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:32:36 user nova-compute[75017]:   </features>
Oct 30 09:32:36 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:32:36 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:32:36 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:32:36 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:32:36 user nova-compute[75017]:   </clock>
Oct 30 09:32:36 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:32:36 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:32:36 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:32:36 user nova-compute[75017]:   </cpu>
Oct 30 09:32:36 user nova-compute[75017]:   <devices>
Oct 30 09:32:36 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:32:36 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:32:36 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk"/>
Oct 30 09:32:36 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:32:36 user nova-compute[75017]:     </disk>
Oct 30 09:32:36 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:32:36 user nova-compute[75017]:       <mac address="fa:16:3e:7c:14:28"/>
Oct 30 09:32:36 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:32:36 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:32:36 user nova-compute[75017]:       <target dev="tape060ba01-59"/>
Oct 30 09:32:36 user nova-compute[75017]:     </interface>
Oct 30 09:32:36 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:32:36 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/console.log" append="off"/>
Oct 30 09:32:36 user nova-compute[75017]:     </serial>
Oct 30 09:32:36 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:32:36 user nova-compute[75017]:     <video>
Oct 30 09:32:36 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:32:36 user nova-compute[75017]:     </video>
Oct 30 09:32:36 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:32:36 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:32:36 user nova-compute[75017]:     </rng>
Oct 30 09:32:36 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:32:36 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:32:36 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:32:36 user nova-compute[75017]:     </memballoon>
Oct 30 09:32:36 user nova-compute[75017]:   </devices>
Oct 30 09:32:36 user nova-compute[75017]: </domain>
Oct 30 09:32:36 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-731552492',display_name='tempest-TestMinimumBasicScenario-server-731552492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-731552492',id=38,image_ref='29e6f143-eb31-486f-9a12-ca9be6ff8adc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN8HM2ppUbiiRNlRtAjnDhOOCi0tEJPMVseOsi6EF3jYCNB+VYo1NN1WFEEbLUjkvhgfd9/jM7gf4Pj6dEvQ6jYnoHhYAHQaeSCGYMz4P4Y25ff+pqH9eGNH2wNR/zXLw==',key_name='tempest-TestMinimumBasicScenario-1041607142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c084ddae4af6448ca2f5b36497ab3a2b',ramdisk_id='',reservation_id='r-06io560d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='29e6f143-eb31-486f-9a12-ca9be6ff8adc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-692819593',owner_user_name='tempest-TestMinimumBasicScenario-692819593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:32:34Z,user_data=None,user_id='2ab92f42f38f4dbf8826cae09de164dd',uuid=85a15494-ab66-4692-949f-be1b0248971c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converting VIF {"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:14:28,bridge_name='br-int',has_traffic_filtering=True,id=e060ba01-5902-47ef-b07a-900fd6891d5c,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060ba01-59') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG os_vif [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:14:28,bridge_name='br-int',has_traffic_filtering=True,id=e060ba01-5902-47ef-b07a-900fd6891d5c,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060ba01-59') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a93b314a-6c5c-5253-88a8-550d0ccebfaa', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape060ba01-59, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape060ba01-59, col_values=(('qos', UUID('5c334ea9-9df6-41a7-8bb4-c9a032af04d0')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape060ba01-59, col_values=(('external_ids', {'iface-id': 'e060ba01-5902-47ef-b07a-900fd6891d5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:14:28', 'vm-uuid': '85a15494-ab66-4692-949f-be1b0248971c'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:37 user nova-compute[75017]: INFO os_vif [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:14:28,bridge_name='br-int',has_traffic_filtering=True,id=e060ba01-5902-47ef-b07a-900fd6891d5c,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060ba01-59')
Oct 30 09:32:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No VIF found with MAC fa:16:3e:7c:14:28, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG nova.network.neutron [req-64ee8cf6-01ad-4cd1-8455-fff0fb17b3b2 req-35eb354c-1a25-4623-a566-933c87048e0b service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updated VIF entry in instance network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG nova.network.neutron [req-64ee8cf6-01ad-4cd1-8455-fff0fb17b3b2 req-35eb354c-1a25-4623-a566-933c87048e0b service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating instance_info_cache with network_info: [{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-64ee8cf6-01ad-4cd1-8455-fff0fb17b3b2 req-35eb354c-1a25-4623-a566-933c87048e0b service nova] Releasing lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updating instance_info_cache with network_info: [{"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:32:38 user nova-compute[75017]: INFO nova.compute.claims [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Claim successful on node user
Oct 30 09:32:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:32:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:32:38 user nova-compute[75017]: INFO nova.virt.block_device [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Booting with blank volume at /dev/vda
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcaa446f-48c5-411c-8063-4572cef89a0a req-b3bedc26-85be-4d82-b81d-4eb6f3c285b7 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcaa446f-48c5-411c-8063-4572cef89a0a req-b3bedc26-85be-4d82-b81d-4eb6f3c285b7 service nova] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcaa446f-48c5-411c-8063-4572cef89a0a req-b3bedc26-85be-4d82-b81d-4eb6f3c285b7 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcaa446f-48c5-411c-8063-4572cef89a0a req-b3bedc26-85be-4d82-b81d-4eb6f3c285b7 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcaa446f-48c5-411c-8063-4572cef89a0a req-b3bedc26-85be-4d82-b81d-4eb6f3c285b7 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] No waiting events found dispatching network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:32:38 user nova-compute[75017]: WARNING nova.compute.manager [req-bcaa446f-48c5-411c-8063-4572cef89a0a req-b3bedc26-85be-4d82-b81d-4eb6f3c285b7 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received unexpected event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c for instance with vm_state building and task_state spawning.
Oct 30 09:32:38 user nova-compute[75017]: DEBUG nova.policy [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd734d26551bc41a585d443a24fac0cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ba6409f82447ba9d0f4f56eef88b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:32:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:39 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Successfully created port: b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Successfully updated port: b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquired lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updating instance_info_cache with network_info: [{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Releasing lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Instance network_info: |[{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] No waiting events found dispatching network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:32:40 user nova-compute[75017]: WARNING nova.compute.manager [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received unexpected event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c for instance with vm_state building and task_state spawning.
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-changed-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Refreshing instance network info cache due to event network-changed-b857c2d6-780f-4bb7-a3cc-722b83e893d4. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] Acquiring lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] Acquired lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:32:40 user nova-compute[75017]: DEBUG nova.network.neutron [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Refreshing network info cache for port b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:32:41 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Instance spawned successfully.
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:32:41 user nova-compute[75017]: INFO nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Took 6.77 seconds to spawn the instance on the hypervisor.
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:41 user nova-compute[75017]: INFO nova.compute.manager [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Took 7.48 seconds to build instance.
Oct 30 09:32:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-10f33503-d00e-4a92-b727-7d85236fe772 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.578s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updated VIF entry in instance network info cache for port b857c2d6-780f-4bb7-a3cc-722b83e893d4. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updating instance_info_cache with network_info: [{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:32:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c4161704-f5a6-4326-95de-5a7bd4bcef60 req-5a524635-67bf-4e27-ba0b-79d6b34147c8 service nova] Releasing lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:32:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG os_brick.utils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba71bbc2-de73-4f30-9dd1-668c7ebd3ae3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c633e0-e5ea-4ac4-b7e8-6b3604e81111]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ba0176-1ac4-4c8b-a27d-16ca75b028da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb2795e-f329-4738-8837-cda882555adc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:32:44 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:32:44 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a050d23b-f996-4b52-a69a-a5cf0935cc86]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG os_brick.utils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:32:44 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updating existing volume attachment record: 75179c90-6f13-4bb4-ac2f-af6aadad3783 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:32:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjCeiwUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:32:52 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:32:52 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:32:52 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba7fc5f-90ad-4509-9e65-0a5dfbcab470]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:32:52 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b8553e-e275-4704-8f09-5cbf58ec9fc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c] added
Oct 30 09:32:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d6d3c-2937-484f-9999-3547be0a24a2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ab98fc-5dc5-4fda-88bb-ef95fdfd9579]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sjCeiwUz {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sjCeiwUz" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d71491c-cc62-4474-b22a-f77146a0c20c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sjCeiwUz'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6f2f36-92a6-484e-a4d7-e53bee05cfb6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbca8c6-899b-4570-b37e-e4efce299822]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:32:52 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:32:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:32:52 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:32:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d97ff4-1c88-4655-af21-e40bf3e8744f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c, portal: 172.16.0.220,3260]
Oct 30 09:32:52 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c, portal: 172.16.0.220,3260] successful.
Oct 30 09:32:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e262d122-69c3-417c-9d3a-065ff03915e4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6153f8f-cc27-421a-92bf-cfed243f1b58]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:32:52 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:32:52 user nova-compute[75017]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)
Oct 30 09:32:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:32:52 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:32:52 user nova-compute[75017]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)
Oct 30 09:32:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd128a9-1639-4c3e-85a5-18dfd43a0564]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:32:52 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjCeiwUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26235633134623062', 'path': '/dev/sdd'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235633134623062', 'path': '/dev/sdd'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG nova.objects.instance [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'flavor' on Instance uuid bfbdfdec-fa8f-4c30-999b-8975cbfc37ef {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:32:53 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:32:53 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:32:53 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:32:53 user nova-compute[75017]:   <serial>4e363393-eab1-499b-8073-38eda718422c</serial>
Oct 30 09:32:53 user nova-compute[75017]: </disk>
Oct 30 09:32:53 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:32:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No VIF found with MAC fa:16:3e:e2:55:17, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:32:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-01f26fba-89b2-4893-9709-b0a4f0c73377 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.774s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:32:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:56 user nova-compute[75017]: INFO nova.compute.manager [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Detaching volume 4e363393-eab1-499b-8073-38eda718422c
Oct 30 09:32:57 user nova-compute[75017]: INFO nova.virt.block_device [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Attempting to driver detach volume 4e363393-eab1-499b-8073-38eda718422c from mountpoint /dev/vdb
Oct 30 09:32:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:32:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Attempting to detach device vdb from instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:32:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:32:57 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:32:57 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:32:57 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:32:57 user nova-compute[75017]:   <serial>4e363393-eab1-499b-8073-38eda718422c</serial>
Oct 30 09:32:57 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:32:57 user nova-compute[75017]: </disk>
Oct 30 09:32:57 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:32:57 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Successfully detached device vdb from instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef from the persistent domain config.
Oct 30 09:32:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:32:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:32:57 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:32:57 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:32:57 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:32:57 user nova-compute[75017]:   <serial>4e363393-eab1-499b-8073-38eda718422c</serial>
Oct 30 09:32:57 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:32:57 user nova-compute[75017]: </disk>
Oct 30 09:32:57 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:32:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:32:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:32:57 user nova-compute[75017]: INFO nova.compute.manager [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Detaching volume d957c5b2-2d55-479b-8f68-94252d3b1115
Oct 30 09:32:57 user nova-compute[75017]: INFO nova.virt.block_device [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Attempting to driver detach volume d957c5b2-2d55-479b-8f68-94252d3b1115 from mountpoint /dev/vdc
Oct 30 09:32:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Attempting to detach device vdc from instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:32:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:32:57 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:32:57 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:32:57 user nova-compute[75017]:   <target dev="vdc" bus="virtio"/>
Oct 30 09:32:57 user nova-compute[75017]:   <serial>d957c5b2-2d55-479b-8f68-94252d3b1115</serial>
Oct 30 09:32:57 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 09:32:57 user nova-compute[75017]: </disk>
Oct 30 09:32:57 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:32:57 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully detached device vdc from instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 from the persistent domain config.
Oct 30 09:32:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:32:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:32:57 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:32:57 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:32:57 user nova-compute[75017]:   <target dev="vdc" bus="virtio"/>
Oct 30 09:32:57 user nova-compute[75017]:   <serial>d957c5b2-2d55-479b-8f68-94252d3b1115</serial>
Oct 30 09:32:57 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 09:32:57 user nova-compute[75017]: </disk>
Oct 30 09:32:57 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:32:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:32:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:33:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:02 user nova-compute[75017]: INFO nova.compute.manager [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Terminating instance
Oct 30 09:33:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:33:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-96f3f34b-ec33-49b4-a5ce-143b5677d2e2 req-1e50ca13-9636-463a-a93f-7e1fe01ac75b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-unplugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96f3f34b-ec33-49b4-a5ce-143b5677d2e2 req-1e50ca13-9636-463a-a93f-7e1fe01ac75b service nova] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96f3f34b-ec33-49b4-a5ce-143b5677d2e2 req-1e50ca13-9636-463a-a93f-7e1fe01ac75b service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-96f3f34b-ec33-49b4-a5ce-143b5677d2e2 req-1e50ca13-9636-463a-a93f-7e1fe01ac75b service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-96f3f34b-ec33-49b4-a5ce-143b5677d2e2 req-1e50ca13-9636-463a-a93f-7e1fe01ac75b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] No waiting events found dispatching network-vif-unplugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-96f3f34b-ec33-49b4-a5ce-143b5677d2e2 req-1e50ca13-9636-463a-a93f-7e1fe01ac75b service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-unplugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Instance destroyed successfully.
Oct 30 09:33:03 user nova-compute[75017]: DEBUG nova.objects.instance [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'resources' on Instance uuid 7ce43b8f-adcf-4650-9b56-8558ca386fe7 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1187124425',display_name='tempest-ServerRescueNegativeTestJSON-server-1187124425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1187124425',id=15,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:18:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-3v4aele9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:18:09Z,user_data=None,user_id='e7b340dac0544150bc642f7ecfb07157',uuid=7ce43b8f-adcf-4650-9b56-8558ca386fe7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "address": "fa:16:3e:2f:af:95", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099d535-21", "ovs_interfaceid": "8099d535-21b3-4fcb-90eb-5680fb503fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:af:95,bridge_name='br-int',has_traffic_filtering=True,id=8099d535-21b3-4fcb-90eb-5680fb503fa1,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099d535-21') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG os_vif [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:af:95,bridge_name='br-int',has_traffic_filtering=True,id=8099d535-21b3-4fcb-90eb-5680fb503fa1,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099d535-21') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8099d535-21, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e926edce-106d-41ec-8eb2-60d06d10540c) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:03 user nova-compute[75017]: INFO os_vif [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:af:95,bridge_name='br-int',has_traffic_filtering=True,id=8099d535-21b3-4fcb-90eb-5680fb503fa1,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099d535-21')
Oct 30 09:33:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Deleting instance files /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7_del
Oct 30 09:33:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Deletion of /opt/stack/data/nova/instances/7ce43b8f-adcf-4650-9b56-8558ca386fe7_del complete
Oct 30 09:33:03 user nova-compute[75017]: INFO nova.compute.manager [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 30 09:33:03 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:33:03 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:33:04 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Took 0.44 seconds to deallocate network for instance.
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-c0ebf649-fd7c-42f1-9ec4-43c6488adf41 req-2801f852-9fa0-40bc-91b9-99741cb25751 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-deleted-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:04 user nova-compute[75017]: INFO nova.compute.manager [req-c0ebf649-fd7c-42f1-9ec4-43c6488adf41 req-2801f852-9fa0-40bc-91b9-99741cb25751 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Neutron deleted interface 8099d535-21b3-4fcb-90eb-5680fb503fa1; detaching it from the instance and deleting it from the info cache
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.network.neutron [req-c0ebf649-fd7c-42f1-9ec4-43c6488adf41 req-2801f852-9fa0-40bc-91b9-99741cb25751 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-c0ebf649-fd7c-42f1-9ec4-43c6488adf41 req-2801f852-9fa0-40bc-91b9-99741cb25751 service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Detach interface failed, port_id=8099d535-21b3-4fcb-90eb-5680fb503fa1, reason: Instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:04 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Deleted allocations for instance 7ce43b8f-adcf-4650-9b56-8558ca386fe7
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-42c695cd-785e-4b86-ba95-0d7d7bf5caa4 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.916s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:33:04 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Creating image(s)
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Ensure instance console log exists: /opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Start _get_guest_xml network_info=[{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msADnxTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5279c2eb-3996-4b46-8925-81a5d7022c5f', 'attached_at': '', 'detached_at': '', 'volume_id': '0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 'serial': '0ca80d7d-9669-44b0-a3bf-5ec837f3acb0'}, 'disk_bus': 'virtio', 'attachment_id': '75179c90-6f13-4bb4-ac2f-af6aadad3783', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:33:04 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:33:04 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msADnxTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:33:04 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:33:04 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:33:04 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cf825f-5db5-4785-810f-bce79731306f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:33:04 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a76f2-3d8a-4d43-84c5-4f8c679f4283]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0] added
Oct 30 09:33:04 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3377b19c-1424-400f-a456-4f3a4b6ebead]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[761a79de-9adf-4591-b635-3a78ff4c1488]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msADnxTO {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msADnxTO" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ab924f-c7a6-495a-a764-c64948a4a463]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'msADnxTO'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2621e0-028c-414e-b4cc-64e17afe4155]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b59e8d-e2bf-4252-83b5-084f9a3744e9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:33:04 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:04 user nova-compute[75017]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)
Oct 30 09:33:04 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:33:04 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:04 user nova-compute[75017]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)
Oct 30 09:33:04 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:33:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f465e1-1665-48aa-a962-ffc7323a2264]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0, portal: 172.16.0.220,3260]
Oct 30 09:33:05 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0, portal: 172.16.0.220,3260] successful.
Oct 30 09:33:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8ba6cd-d805-45bd-abee-879d1b7b90db]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eb255f-846c-409e-9348-b338be70d3d3]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:33:05 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:05 user nova-compute[75017]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)
Oct 30 09:33:05 user nova-compute[75017]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:33:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:33:05 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:05 user nova-compute[75017]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)
Oct 30 09:33:05 user nova-compute[75017]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:33:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d452ea-df29-4be7-9eb4-14f1b0a18c2a]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msADnxTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-8a152ad3-1349-46e6-83f1-d18b58eec35d req-34b6bbc8-2631-42c8-abb6-cee9280c6f5d service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8a152ad3-1349-46e6-83f1-d18b58eec35d req-34b6bbc8-2631-42c8-abb6-cee9280c6f5d service nova] Acquiring lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8a152ad3-1349-46e6-83f1-d18b58eec35d req-34b6bbc8-2631-42c8-abb6-cee9280c6f5d service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8a152ad3-1349-46e6-83f1-d18b58eec35d req-34b6bbc8-2631-42c8-abb6-cee9280c6f5d service nova] Lock "7ce43b8f-adcf-4650-9b56-8558ca386fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-8a152ad3-1349-46e6-83f1-d18b58eec35d req-34b6bbc8-2631-42c8-abb6-cee9280c6f5d service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] No waiting events found dispatching network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:05 user nova-compute[75017]: WARNING nova.compute.manager [req-8a152ad3-1349-46e6-83f1-d18b58eec35d req-34b6bbc8-2631-42c8-abb6-cee9280c6f5d service nova] [instance: 7ce43b8f-adcf-4650-9b56-8558ca386fe7] Received unexpected event network-vif-plugged-8099d535-21b3-4fcb-90eb-5680fb503fa1 for instance with vm_state deleted and task_state None.
Oct 30 09:33:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23064336631316635', 'path': '/dev/sde'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064336631316635', 'path': '/dev/sde'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2128039297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2128039297',id=39,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-3b9q1b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:32:39Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=5279c2eb-3996-4b46-8925-81a5d7022c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:06:69,bridge_name='br-int',has_traffic_filtering=True,id=b857c2d6-780f-4bb7-a3cc-722b83e893d4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb857c2d6-78') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.objects.instance [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'pci_devices' on Instance uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:33:06 user nova-compute[75017]:   <uuid>5279c2eb-3996-4b46-8925-81a5d7022c5f</uuid>
Oct 30 09:33:06 user nova-compute[75017]:   <name>instance-00000027</name>
Oct 30 09:33:06 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:33:06 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:33:06 user nova-compute[75017]:   <metadata>
Oct 30 09:33:06 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:33:06 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:33:06 user nova-compute[75017]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2128039297</nova:name>
Oct 30 09:33:06 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:33:04</nova:creationTime>
Oct 30 09:33:06 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:33:06 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:33:06 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:33:06 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:33:06 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:33:06 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:33:06 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:33:06 user nova-compute[75017]:       <nova:owner>
Oct 30 09:33:06 user nova-compute[75017]:         <nova:user uuid="d734d26551bc41a585d443a24fac0cd8">tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member</nova:user>
Oct 30 09:33:06 user nova-compute[75017]:         <nova:project uuid="76ba6409f82447ba9d0f4f56eef88b1d">tempest-ServerBootFromVolumeStableRescueTest-1506388181</nova:project>
Oct 30 09:33:06 user nova-compute[75017]:       </nova:owner>
Oct 30 09:33:06 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:33:06 user nova-compute[75017]:       <nova:ports>
Oct 30 09:33:06 user nova-compute[75017]:         <nova:port uuid="b857c2d6-780f-4bb7-a3cc-722b83e893d4">
Oct 30 09:33:06 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:33:06 user nova-compute[75017]:         </nova:port>
Oct 30 09:33:06 user nova-compute[75017]:       </nova:ports>
Oct 30 09:33:06 user nova-compute[75017]:     </nova:instance>
Oct 30 09:33:06 user nova-compute[75017]:   </metadata>
Oct 30 09:33:06 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:33:06 user nova-compute[75017]:     <system>
Oct 30 09:33:06 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:33:06 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:33:06 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:33:06 user nova-compute[75017]:       <entry name="serial">5279c2eb-3996-4b46-8925-81a5d7022c5f</entry>
Oct 30 09:33:06 user nova-compute[75017]:       <entry name="uuid">5279c2eb-3996-4b46-8925-81a5d7022c5f</entry>
Oct 30 09:33:06 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:33:06 user nova-compute[75017]:     </system>
Oct 30 09:33:06 user nova-compute[75017]:   </sysinfo>
Oct 30 09:33:06 user nova-compute[75017]:   <os>
Oct 30 09:33:06 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:33:06 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:33:06 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:33:06 user nova-compute[75017]:   </os>
Oct 30 09:33:06 user nova-compute[75017]:   <features>
Oct 30 09:33:06 user nova-compute[75017]:     <acpi/>
Oct 30 09:33:06 user nova-compute[75017]:     <apic/>
Oct 30 09:33:06 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:33:06 user nova-compute[75017]:   </features>
Oct 30 09:33:06 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:33:06 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:33:06 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:33:06 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:33:06 user nova-compute[75017]:   </clock>
Oct 30 09:33:06 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:33:06 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:33:06 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:33:06 user nova-compute[75017]:   </cpu>
Oct 30 09:33:06 user nova-compute[75017]:   <devices>
Oct 30 09:33:06 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:33:06 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:33:06 user nova-compute[75017]:       <source dev="/dev/sde"/>
Oct 30 09:33:06 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:33:06 user nova-compute[75017]:       <serial>0ca80d7d-9669-44b0-a3bf-5ec837f3acb0</serial>
Oct 30 09:33:06 user nova-compute[75017]:     </disk>
Oct 30 09:33:06 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:33:06 user nova-compute[75017]:       <mac address="fa:16:3e:fe:06:69"/>
Oct 30 09:33:06 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:33:06 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:33:06 user nova-compute[75017]:       <target dev="tapb857c2d6-78"/>
Oct 30 09:33:06 user nova-compute[75017]:     </interface>
Oct 30 09:33:06 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:33:06 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/console.log" append="off"/>
Oct 30 09:33:06 user nova-compute[75017]:     </serial>
Oct 30 09:33:06 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:33:06 user nova-compute[75017]:     <video>
Oct 30 09:33:06 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:33:06 user nova-compute[75017]:     </video>
Oct 30 09:33:06 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:33:06 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:33:06 user nova-compute[75017]:     </rng>
Oct 30 09:33:06 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:33:06 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:33:06 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:33:06 user nova-compute[75017]:     </memballoon>
Oct 30 09:33:06 user nova-compute[75017]:   </devices>
Oct 30 09:33:06 user nova-compute[75017]: </domain>
Oct 30 09:33:06 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2128039297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2128039297',id=39,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-3b9q1b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:32:39Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=5279c2eb-3996-4b46-8925-81a5d7022c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:06:69,bridge_name='br-int',has_traffic_filtering=True,id=b857c2d6-780f-4bb7-a3cc-722b83e893d4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb857c2d6-78') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG os_vif [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:06:69,bridge_name='br-int',has_traffic_filtering=True,id=b857c2d6-780f-4bb7-a3cc-722b83e893d4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb857c2d6-78') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '367585e0-1ac1-57aa-bc33-5a704fa227ce', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb857c2d6-78, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb857c2d6-78, col_values=(('qos', UUID('1d23e9ee-3281-4293-9bb9-64dee0503da5')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb857c2d6-78, col_values=(('external_ids', {'iface-id': 'b857c2d6-780f-4bb7-a3cc-722b83e893d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:06:69', 'vm-uuid': '5279c2eb-3996-4b46-8925-81a5d7022c5f'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:06 user nova-compute[75017]: INFO os_vif [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:06:69,bridge_name='br-int',has_traffic_filtering=True,id=b857c2d6-780f-4bb7-a3cc-722b83e893d4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb857c2d6-78')
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No VIF found with MAC fa:16:3e:fe:06:69, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:33:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-1f7520b1-27d2-4493-8b6e-31ceecd27dbc req-3625decb-b00f-4c0e-b87f-fe7a1843ec58 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1f7520b1-27d2-4493-8b6e-31ceecd27dbc req-3625decb-b00f-4c0e-b87f-fe7a1843ec58 service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1f7520b1-27d2-4493-8b6e-31ceecd27dbc req-3625decb-b00f-4c0e-b87f-fe7a1843ec58 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1f7520b1-27d2-4493-8b6e-31ceecd27dbc req-3625decb-b00f-4c0e-b87f-fe7a1843ec58 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-1f7520b1-27d2-4493-8b6e-31ceecd27dbc req-3625decb-b00f-4c0e-b87f-fe7a1843ec58 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:07 user nova-compute[75017]: WARNING nova.compute.manager [req-1f7520b1-27d2-4493-8b6e-31ceecd27dbc req-3625decb-b00f-4c0e-b87f-fe7a1843ec58 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state building and task_state spawning.
Oct 30 09:33:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-bc90c303-a1d1-477d-9118-04ad893513ab req-58051aca-5148-4c34-88b0-767d6ef3a201 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bc90c303-a1d1-477d-9118-04ad893513ab req-58051aca-5148-4c34-88b0-767d6ef3a201 service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bc90c303-a1d1-477d-9118-04ad893513ab req-58051aca-5148-4c34-88b0-767d6ef3a201 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bc90c303-a1d1-477d-9118-04ad893513ab req-58051aca-5148-4c34-88b0-767d6ef3a201 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-bc90c303-a1d1-477d-9118-04ad893513ab req-58051aca-5148-4c34-88b0-767d6ef3a201 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:09 user nova-compute[75017]: WARNING nova.compute.manager [req-bc90c303-a1d1-477d-9118-04ad893513ab req-58051aca-5148-4c34-88b0-767d6ef3a201 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state building and task_state spawning.
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:33:09 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Instance spawned successfully.
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:33:09 user nova-compute[75017]: INFO nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Took 5.26 seconds to spawn the instance on the hypervisor.
Oct 30 09:33:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:33:10 user nova-compute[75017]: INFO nova.compute.manager [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Took 32.01 seconds to build instance.
Oct 30 09:33:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-5eb40dd6-ac3f-46e3-8e1f-3431097cfa24 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.133s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:10 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:10 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:33:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef is timed out.
Oct 30 09:33:17 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Successfully detached device vdb from instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef from the live domain config.
Oct 30 09:33:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjCeiwUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:33:17 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215ce77-e8af-48c9-a77c-012777d9059a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:33:17 user nova-compute[75017]: No targets found.
Oct 30 09:33:17 user nova-compute[75017]: iSNS:
Oct 30 09:33:17 user nova-compute[75017]: No targets found.
Oct 30 09:33:17 user nova-compute[75017]: STATIC:
Oct 30 09:33:17 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600
Oct 30 09:33:17 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:33:17 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:33:17 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:33:17 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:33:17 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:33:17 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115
Oct 30 09:33:17 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:33:17 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:33:17 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c
Oct 30 09:33:17 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:33:17 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:33:17 user nova-compute[75017]: FIRMWARE:
Oct 30 09:33:17 user nova-compute[75017]: No targets found.
Oct 30 09:33:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:33:17 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:33:17 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[acafa202-56fa-415a-bef6-3fcffb08ad28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded30f91-7eb5-43dd-b2e8-014303692c24]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:33:17 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:17 user nova-compute[75017]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)
Oct 30 09:33:17 user nova-compute[75017]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:33:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:33:17 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:17 user nova-compute[75017]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c (non-flash)
Oct 30 09:33:17 user nova-compute[75017]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:33:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf07e28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c'): ({'sdd'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Removing single pathed devices sdd {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5584ed42-431d-40a6-93cc-9cef1cfc1af6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e61c7af-acb8-4910-afe3-d23b74a9b2b8]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Flushing IO for device /dev/sdd {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ba581-4a34-46b7-b225-018473c8dcee]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d0c4df-502d-459b-9c05-45eaef8d2437]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d359d2c-60bd-49dd-a84f-15fd9705272f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1d6d6c-52be-4835-a5ce-0475eb4bcb14]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c, portal: 172.16.0.220,3260]
Oct 30 09:33:17 user nova-compute[75017]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c, portal: 172.16.0.220,3260] successful.
Oct 30 09:33:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e363393-eab1-499b-8073-38eda718422c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[97232745-4910-44f2-8025-488a76d2807d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] <== disconnect_volume: return (308ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:33:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:33:18 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 is timed out.
Oct 30 09:33:18 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully detached device vdc from instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 from the live domain config.
Oct 30 09:33:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYanbjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:33:18 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1374ad5-6a11-4e32-8e96-df5d7949d546]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:33:18 user nova-compute[75017]: No targets found.
Oct 30 09:33:18 user nova-compute[75017]: iSNS:
Oct 30 09:33:18 user nova-compute[75017]: No targets found.
Oct 30 09:33:18 user nova-compute[75017]: STATIC:
Oct 30 09:33:18 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600
Oct 30 09:33:18 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:33:18 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:33:18 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:33:18 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:33:18 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:33:18 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115
Oct 30 09:33:18 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:33:18 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:33:18 user nova-compute[75017]: FIRMWARE:
Oct 30 09:33:18 user nova-compute[75017]: No targets found.
Oct 30 09:33:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:33:18 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:33:18 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7a628f-a8f9-4708-99fc-dd74d203e0bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed4c324-ea2e-484b-a3e6-58591e367a3e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:33:18 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:18 user nova-compute[75017]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:33:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 (non-flash)
Oct 30 09:33:18 user nova-compute[75017]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:18 user nova-compute[75017]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:33:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd7ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88b344-b180-4135-bf78-a71245c9be3c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[97559c61-24ef-44cd-934e-fd15e9b81f93]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc4bc8-8804-4599-9256-834b0837bc3c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b5f00-869b-428a-bab6-1ff839c88cce]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e1c07a-74b3-48b4-9134-baae4b387f5b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[23645d5c-5a1a-4c56-9780-3771c2944b41]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115, portal: 172.16.0.220,3260]
Oct 30 09:33:18 user nova-compute[75017]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115, portal: 172.16.0.220,3260] successful.
Oct 30 09:33:18 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d957c5b2-2d55-479b-8f68-94252d3b1115 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f52cb7-a0f9-4065-afe7-fa109ece927d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] <== disconnect_volume: return (308ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'flavor' on Instance uuid bfbdfdec-fa8f-4c30-999b-8975cbfc37ef {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:33:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ab0019d4-d1d0-4118-bb74-6c3c1454ad03 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:19 user nova-compute[75017]: DEBUG nova.objects.instance [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'flavor' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:33:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2da0c9d9-c913-43e1-af43-5fcaf8c7c567 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.060s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:23 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:33:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:33:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:33:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:28 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:28 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:33:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:28 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:31 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:33:31 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=7824MB free_disk=25.049739837646484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c6aae433-005c-4b50-9006-d71bca0f8368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7bd36d83-4656-45b6-a7c8-38fd4dc6132f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance ed764905-0085-48a3-ab16-0b108bedf0b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 85a15494-ab66-4692-949f-be1b0248971c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:33:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquiring lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquiring lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:34 user nova-compute[75017]: INFO nova.compute.manager [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Terminating instance
Oct 30 09:33:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-31c688c1-529f-47e2-a0ef-599772b05158 req-b02e5efa-f842-4850-9727-3b34692b2e54 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received event network-vif-unplugged-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-31c688c1-529f-47e2-a0ef-599772b05158 req-b02e5efa-f842-4850-9727-3b34692b2e54 service nova] Acquiring lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-31c688c1-529f-47e2-a0ef-599772b05158 req-b02e5efa-f842-4850-9727-3b34692b2e54 service nova] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-31c688c1-529f-47e2-a0ef-599772b05158 req-b02e5efa-f842-4850-9727-3b34692b2e54 service nova] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-31c688c1-529f-47e2-a0ef-599772b05158 req-b02e5efa-f842-4850-9727-3b34692b2e54 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] No waiting events found dispatching network-vif-unplugged-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-31c688c1-529f-47e2-a0ef-599772b05158 req-b02e5efa-f842-4850-9727-3b34692b2e54 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received event network-vif-unplugged-390c80e5-138c-4baa-8283-964f0d4758fb for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Instance destroyed successfully.
Oct 30 09:33:35 user nova-compute[75017]: DEBUG nova.objects.instance [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lazy-loading 'resources' on Instance uuid 7bd36d83-4656-45b6-a7c8-38fd4dc6132f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1937159920',display_name='tempest-VolumesActionsTest-instance-1937159920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1937159920',id=37,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bf4156f2f8c4f75b83180c05c156c6c',ramdisk_id='',reservation_id='r-jj8wsuc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-828521606',owner_user_name='tempest-VolumesActionsTest-828521606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:31:36Z,user_data=None,user_id='79b297f13e3345f8aa3424e8246d7882',uuid=7bd36d83-4656-45b6-a7c8-38fd4dc6132f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Converting VIF {"id": "390c80e5-138c-4baa-8283-964f0d4758fb", "address": "fa:16:3e:88:73:cb", "network": {"id": "7504972c-3da4-43d4-afe9-d0df8ce3d05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2115080504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf4156f2f8c4f75b83180c05c156c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c80e5-13", "ovs_interfaceid": "390c80e5-138c-4baa-8283-964f0d4758fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:73:cb,bridge_name='br-int',has_traffic_filtering=True,id=390c80e5-138c-4baa-8283-964f0d4758fb,network=Network(7504972c-3da4-43d4-afe9-d0df8ce3d05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c80e5-13') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG os_vif [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:73:cb,bridge_name='br-int',has_traffic_filtering=True,id=390c80e5-138c-4baa-8283-964f0d4758fb,network=Network(7504972c-3da4-43d4-afe9-d0df8ce3d05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c80e5-13') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap390c80e5-13, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fae7e46-f055-4ab2-8178-56f0a24653d4) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:35 user nova-compute[75017]: INFO os_vif [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:73:cb,bridge_name='br-int',has_traffic_filtering=True,id=390c80e5-138c-4baa-8283-964f0d4758fb,network=Network(7504972c-3da4-43d4-afe9-d0df8ce3d05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c80e5-13')
Oct 30 09:33:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Deleting instance files /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f_del
Oct 30 09:33:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Deletion of /opt/stack/data/nova/instances/7bd36d83-4656-45b6-a7c8-38fd4dc6132f_del complete
Oct 30 09:33:35 user nova-compute[75017]: INFO nova.compute.manager [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 30 09:33:35 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:33:35 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Took 0.37 seconds to deallocate network for instance.
Oct 30 09:33:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:36 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:33:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:33:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:36 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Deleted allocations for instance 7bd36d83-4656-45b6-a7c8-38fd4dc6132f
Oct 30 09:33:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-30740cf0-e283-4ebc-bec4-f1fa61c60854 tempest-VolumesActionsTest-828521606 tempest-VolumesActionsTest-828521606-project-member] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.764s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-fd4fb9ac-78a7-4cfa-9b89-b9ee714151a5 req-6f35a901-2f63-48e2-8e1e-e69df6e7e518 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received event network-vif-plugged-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fd4fb9ac-78a7-4cfa-9b89-b9ee714151a5 req-6f35a901-2f63-48e2-8e1e-e69df6e7e518 service nova] Acquiring lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fd4fb9ac-78a7-4cfa-9b89-b9ee714151a5 req-6f35a901-2f63-48e2-8e1e-e69df6e7e518 service nova] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fd4fb9ac-78a7-4cfa-9b89-b9ee714151a5 req-6f35a901-2f63-48e2-8e1e-e69df6e7e518 service nova] Lock "7bd36d83-4656-45b6-a7c8-38fd4dc6132f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-fd4fb9ac-78a7-4cfa-9b89-b9ee714151a5 req-6f35a901-2f63-48e2-8e1e-e69df6e7e518 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] No waiting events found dispatching network-vif-plugged-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:36 user nova-compute[75017]: WARNING nova.compute.manager [req-fd4fb9ac-78a7-4cfa-9b89-b9ee714151a5 req-6f35a901-2f63-48e2-8e1e-e69df6e7e518 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received unexpected event network-vif-plugged-390c80e5-138c-4baa-8283-964f0d4758fb for instance with vm_state deleted and task_state None.
Oct 30 09:33:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-fd4fb9ac-78a7-4cfa-9b89-b9ee714151a5 req-6f35a901-2f63-48e2-8e1e-e69df6e7e518 service nova] [instance: 7bd36d83-4656-45b6-a7c8-38fd4dc6132f] Received event network-vif-deleted-390c80e5-138c-4baa-8283-964f0d4758fb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-9005dc9f-4ba9-4318-8ee4-7419aa26ccaa req-e2235ad0-9d23-410b-8b0b-a3d69e6db925 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-9005dc9f-4ba9-4318-8ee4-7419aa26ccaa req-e2235ad0-9d23-410b-8b0b-a3d69e6db925 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing instance network info cache due to event network-changed-0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9005dc9f-4ba9-4318-8ee4-7419aa26ccaa req-e2235ad0-9d23-410b-8b0b-a3d69e6db925 service nova] Acquiring lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9005dc9f-4ba9-4318-8ee4-7419aa26ccaa req-e2235ad0-9d23-410b-8b0b-a3d69e6db925 service nova] Acquired lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG nova.network.neutron [req-9005dc9f-4ba9-4318-8ee4-7419aa26ccaa req-e2235ad0-9d23-410b-8b0b-a3d69e6db925 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Refreshing network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:37 user nova-compute[75017]: INFO nova.compute.manager [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Terminating instance
Oct 30 09:33:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG nova.network.neutron [req-9005dc9f-4ba9-4318-8ee4-7419aa26ccaa req-e2235ad0-9d23-410b-8b0b-a3d69e6db925 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updated VIF entry in instance network info cache for port 0c2e76af-b907-47c9-a852-37fd61d79304. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG nova.network.neutron [req-9005dc9f-4ba9-4318-8ee4-7419aa26ccaa req-e2235ad0-9d23-410b-8b0b-a3d69e6db925 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [{"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9005dc9f-4ba9-4318-8ee4-7419aa26ccaa req-e2235ad0-9d23-410b-8b0b-a3d69e6db925 service nova] Releasing lock "refresh_cache-ed764905-0085-48a3-ab16-0b108bedf0b2" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:33:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Skipping network cache update for instance because it is being deleted. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Instance destroyed successfully.
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.objects.instance [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lazy-loading 'resources' on Instance uuid ed764905-0085-48a3-ab16-0b108bedf0b2 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1247832894',display_name='tempest-TestShelveInstance-server-1247832894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1247832894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH8t7GCNbcPfamzUk2HB8C3+7YghSSRH7vosrDgdDKcel1cb5Bm2LcgI6C6JLt7egD8a9FPQj+2T/hKfoDX8+HBuX5kTKPTyCI6QRkOalZnFz/WGuWlKVV4gByFM0wsgA==',key_name='tempest-TestShelveInstance-1640079032',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:32:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97e979003a534f9f844a4c60ae72c6b1',ramdisk_id='',reservation_id='r-pl2apff0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-251967741',owner_user_name='tempest-TestShelveInstance-251967741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:32:13Z,user_data=None,user_id='eb0397935e524c6c9da95caa125a1627',uuid=ed764905-0085-48a3-ab16-0b108bedf0b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converting VIF {"id": "0c2e76af-b907-47c9-a852-37fd61d79304", "address": "fa:16:3e:a2:45:25", "network": {"id": "b44803d1-66e1-4d7f-8c90-901d033a6bb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1037372404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97e979003a534f9f844a4c60ae72c6b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2e76af-b9", "ovs_interfaceid": "0c2e76af-b907-47c9-a852-37fd61d79304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_vif [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c2e76af-b9, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67200110-2b61-4648-b304-b94bcf7276f0) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:38 user nova-compute[75017]: INFO os_vif [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:45:25,bridge_name='br-int',has_traffic_filtering=True,id=0c2e76af-b907-47c9-a852-37fd61d79304,network=Network(b44803d1-66e1-4d7f-8c90-901d033a6bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2e76af-b9')
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNmcLnKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:33:38 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e45b2b1-bef1-4e15-ab1d-16dceec5e597]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:33:38 user nova-compute[75017]: No targets found.
Oct 30 09:33:38 user nova-compute[75017]: iSNS:
Oct 30 09:33:38 user nova-compute[75017]: No targets found.
Oct 30 09:33:38 user nova-compute[75017]: STATIC:
Oct 30 09:33:38 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600
Oct 30 09:33:38 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:33:38 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:33:38 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:33:38 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:33:38 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:33:38 user nova-compute[75017]: FIRMWARE:
Oct 30 09:33:38 user nova-compute[75017]: No targets found.
Oct 30 09:33:38 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:33:38 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:33:38 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee620d38-0780-4da5-a6bb-e9789561b4ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3822b9b5-c564-409f-943c-6822b7a27ed7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:38 user nova-compute[75017]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:33:38 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 (non-flash)
Oct 30 09:33:38 user nova-compute[75017]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:33:38 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf0629bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a7493a-2626-463b-b01e-0751bca3a1b7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59a4407-4f40-477d-8246-176ae70b1088]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f92c18b-a0f1-4363-b305-4edb18d23fc6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1a54d2-7669-48fc-94eb-02d27ad23f61]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23965353936326265', '/dev/disk/by-id/scsi-1SCST_BIO21042b2d-9e5962be6296e723', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_21042b2d') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fd37aa-a273-4667-95dc-6d669f749897]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a1b5fe-e2d0-456c-8ce4-23f5453e2575]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de6864d-6665-46df-b4a4-4251eb6dfd5b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260]
Oct 30 09:33:38 user nova-compute[75017]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600, portal: 172.16.0.220,3260] successful.
Oct 30 09:33:38 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2380b941-e961-4298-9cb7-586dbcfd2600 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375d6b8-b893-4491-a07a-f4a92d34b285]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] <== disconnect_volume: return (302ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:33:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Deleting instance files /opt/stack/data/nova/instances/ed764905-0085-48a3-ab16-0b108bedf0b2_del
Oct 30 09:33:38 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Deletion of /opt/stack/data/nova/instances/ed764905-0085-48a3-ab16-0b108bedf0b2_del complete
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updating instance_info_cache with network_info: [{"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-c6aae433-005c-4b50-9006-d71bca0f8368" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:33:38 user nova-compute[75017]: INFO nova.compute.manager [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 30 09:33:38 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:33:38 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:33:39 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Took 0.44 seconds to deallocate network for instance.
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-67d0c7d7-ad56-4689-ade6-20ad36d92a58 req-74e77953-987f-456f-bcd0-f273c9a432a4 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-deleted-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:39 user nova-compute[75017]: INFO nova.compute.manager [req-67d0c7d7-ad56-4689-ade6-20ad36d92a58 req-74e77953-987f-456f-bcd0-f273c9a432a4 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Neutron deleted interface 0c2e76af-b907-47c9-a852-37fd61d79304; detaching it from the instance and deleting it from the info cache
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.network.neutron [req-67d0c7d7-ad56-4689-ade6-20ad36d92a58 req-74e77953-987f-456f-bcd0-f273c9a432a4 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-67d0c7d7-ad56-4689-ade6-20ad36d92a58 req-74e77953-987f-456f-bcd0-f273c9a432a4 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Detach interface failed, port_id=0c2e76af-b907-47c9-a852-37fd61d79304, reason: Instance ed764905-0085-48a3-ab16-0b108bedf0b2 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-unplugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] No waiting events found dispatching network-vif-unplugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-unplugged-0c2e76af-b907-47c9-a852-37fd61d79304 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] Acquiring lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.compute.manager [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] No waiting events found dispatching network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:39 user nova-compute[75017]: WARNING nova.compute.manager [req-ae22e567-9c8c-433c-9d1c-065cf07a090b req-103235f9-5cf3-44ba-8fb2-27d0303b7c59 service nova] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Received unexpected event network-vif-plugged-0c2e76af-b907-47c9-a852-37fd61d79304 for instance with vm_state active and task_state deleting.
Oct 30 09:33:39 user nova-compute[75017]: INFO nova.compute.manager [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Took 0.93 seconds to detach 1 volumes for instance.
Oct 30 09:33:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] [instance: ed764905-0085-48a3-ab16-0b108bedf0b2] Deleting volume: 2380b941-e961-4298-9cb7-586dbcfd2600 {{(pid=75017) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 09:33:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:40 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:33:40 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:33:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:40 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Deleted allocations for instance ed764905-0085-48a3-ab16-0b108bedf0b2
Oct 30 09:33:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3b002303-a7aa-4b89-be4a-ab1bd01ab367 tempest-TestShelveInstance-251967741 tempest-TestShelveInstance-251967741-project-member] Lock "ed764905-0085-48a3-ab16-0b108bedf0b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.204s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:33:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:47 user nova-compute[75017]: INFO nova.compute.manager [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Terminating instance
Oct 30 09:33:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-853ca69e-83f0-44cc-a86f-5358846ad961 req-805c306d-52b2-4256-a0a3-989b1d449b04 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-unplugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-853ca69e-83f0-44cc-a86f-5358846ad961 req-805c306d-52b2-4256-a0a3-989b1d449b04 service nova] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-853ca69e-83f0-44cc-a86f-5358846ad961 req-805c306d-52b2-4256-a0a3-989b1d449b04 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-853ca69e-83f0-44cc-a86f-5358846ad961 req-805c306d-52b2-4256-a0a3-989b1d449b04 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-853ca69e-83f0-44cc-a86f-5358846ad961 req-805c306d-52b2-4256-a0a3-989b1d449b04 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] No waiting events found dispatching network-vif-unplugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-853ca69e-83f0-44cc-a86f-5358846ad961 req-805c306d-52b2-4256-a0a3-989b1d449b04 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-unplugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:48 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Instance destroyed successfully.
Oct 30 09:33:48 user nova-compute[75017]: DEBUG nova.objects.instance [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'resources' on Instance uuid f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1080550565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1080550565',id=33,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUVzmLwbiPXmN9NnSoYBIvC/rFJO8MjqfeNSMbICD5lP9UAYd18J188Rw97Qor3U45PP3nRzLD6zD+fkYyhh9wdWYbFeUn75NgKrAsJb+o4booXMiG+U6LFXn34r9ao1A==',key_name='tempest-keypair-595798195',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:31:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-30au1thv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "address": "fa:16:3e:c5:da:8b", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d294406-a8", "ovs_interfaceid": "5d294406-a8a6-4939-925a-3a5a72dbc2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG os_vif [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d294406-a8, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=559054ad-944d-4caf-b408-3361a415c845) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:48 user nova-compute[75017]: INFO os_vif [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=5d294406-a8a6-4939-925a-3a5a72dbc2f5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d294406-a8')
Oct 30 09:33:48 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Deleting instance files /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12_del
Oct 30 09:33:48 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Deletion of /opt/stack/data/nova/instances/f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12_del complete
Oct 30 09:33:48 user nova-compute[75017]: INFO nova.compute.manager [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 30 09:33:48 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:33:48 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:33:49 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:33:49 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Took 0.90 seconds to deallocate network for instance.
Oct 30 09:33:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-03bd0e01-de93-4733-91dc-fbe826eef5d1 req-cea327f5-ee1d-4aac-9210-e0eabe5cf833 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-deleted-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:49 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:33:49 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:33:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:49 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Deleted allocations for instance f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12
Oct 30 09:33:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-7069d768-2099-43aa-8150-ece1c64b3dfd tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.340s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-42725763-1db3-4ada-b1a2-0ad4e9d8593c req-14ae57c8-9f81-4b98-bfba-38cc466f8cd3 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-42725763-1db3-4ada-b1a2-0ad4e9d8593c req-14ae57c8-9f81-4b98-bfba-38cc466f8cd3 service nova] Acquiring lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-42725763-1db3-4ada-b1a2-0ad4e9d8593c req-14ae57c8-9f81-4b98-bfba-38cc466f8cd3 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-42725763-1db3-4ada-b1a2-0ad4e9d8593c req-14ae57c8-9f81-4b98-bfba-38cc466f8cd3 service nova] Lock "f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-42725763-1db3-4ada-b1a2-0ad4e9d8593c req-14ae57c8-9f81-4b98-bfba-38cc466f8cd3 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] No waiting events found dispatching network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:50 user nova-compute[75017]: WARNING nova.compute.manager [req-42725763-1db3-4ada-b1a2-0ad4e9d8593c req-14ae57c8-9f81-4b98-bfba-38cc466f8cd3 service nova] [instance: f2bfcdb8-f176-4c15-9b7c-a435f0e2ea12] Received unexpected event network-vif-plugged-5d294406-a8a6-4939-925a-3a5a72dbc2f5 for instance with vm_state deleted and task_state None.
Oct 30 09:33:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "c6aae433-005c-4b50-9006-d71bca0f8368" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:53 user nova-compute[75017]: INFO nova.compute.manager [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Terminating instance
Oct 30 09:33:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:33:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-82273c90-050a-41d8-bb14-91513bee6675 req-25eaef9a-2fe6-4cf0-bd06-521ef1b2a202 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-unplugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-82273c90-050a-41d8-bb14-91513bee6675 req-25eaef9a-2fe6-4cf0-bd06-521ef1b2a202 service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-82273c90-050a-41d8-bb14-91513bee6675 req-25eaef9a-2fe6-4cf0-bd06-521ef1b2a202 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-82273c90-050a-41d8-bb14-91513bee6675 req-25eaef9a-2fe6-4cf0-bd06-521ef1b2a202 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-82273c90-050a-41d8-bb14-91513bee6675 req-25eaef9a-2fe6-4cf0-bd06-521ef1b2a202 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-unplugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-82273c90-050a-41d8-bb14-91513bee6675 req-25eaef9a-2fe6-4cf0-bd06-521ef1b2a202 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-unplugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Instance destroyed successfully.
Oct 30 09:33:54 user nova-compute[75017]: DEBUG nova.objects.instance [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lazy-loading 'resources' on Instance uuid c6aae433-005c-4b50-9006-d71bca0f8368 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1708607494',display_name='tempest-ServerRescueNegativeTestJSON-server-1708607494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1708607494',id=13,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c1e0e03de5c497a94c9c6267e623573',ramdisk_id='',reservation_id='r-skov6gww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1002551965',owner_user_name='tempest-ServerRescueNegativeTestJSON-1002551965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:22:57Z,user_data=None,user_id='e7b340dac0544150bc642f7ecfb07157',uuid=c6aae433-005c-4b50-9006-d71bca0f8368,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converting VIF {"id": "bc2ab399-b4af-40af-b756-74b48450eb12", "address": "fa:16:3e:53:eb:56", "network": {"id": "6eb34481-9fc3-41a7-b195-b474b9957d9a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1512937616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1e0e03de5c497a94c9c6267e623573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc2ab399-b4", "ovs_interfaceid": "bc2ab399-b4af-40af-b756-74b48450eb12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:eb:56,bridge_name='br-int',has_traffic_filtering=True,id=bc2ab399-b4af-40af-b756-74b48450eb12,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc2ab399-b4') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG os_vif [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:eb:56,bridge_name='br-int',has_traffic_filtering=True,id=bc2ab399-b4af-40af-b756-74b48450eb12,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc2ab399-b4') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc2ab399-b4, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d9cb8d7-87a5-4cb3-9b7e-4514b6f4999d) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:33:54 user nova-compute[75017]: INFO os_vif [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:eb:56,bridge_name='br-int',has_traffic_filtering=True,id=bc2ab399-b4af-40af-b756-74b48450eb12,network=Network(6eb34481-9fc3-41a7-b195-b474b9957d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc2ab399-b4')
Oct 30 09:33:54 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Deleting instance files /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368_del
Oct 30 09:33:54 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Deletion of /opt/stack/data/nova/instances/c6aae433-005c-4b50-9006-d71bca0f8368_del complete
Oct 30 09:33:54 user nova-compute[75017]: INFO nova.compute.manager [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 30 09:33:54 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:33:54 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:33:55 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:33:55 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Took 0.50 seconds to deallocate network for instance.
Oct 30 09:33:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:55 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:33:55 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:33:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:55 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Deleted allocations for instance c6aae433-005c-4b50-9006-d71bca0f8368
Oct 30 09:33:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-8d0eb513-c4a3-4e62-8d3b-b0216e5b0700 tempest-ServerRescueNegativeTestJSON-1002551965 tempest-ServerRescueNegativeTestJSON-1002551965-project-member] Lock "c6aae433-005c-4b50-9006-d71bca0f8368" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.618s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-6f6a97d3-33f3-4e22-9288-47615f9dd0ea req-f185cfa2-7993-4bc2-bc93-c4476df92d54 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6f6a97d3-33f3-4e22-9288-47615f9dd0ea req-f185cfa2-7993-4bc2-bc93-c4476df92d54 service nova] Acquiring lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:33:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6f6a97d3-33f3-4e22-9288-47615f9dd0ea req-f185cfa2-7993-4bc2-bc93-c4476df92d54 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:33:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6f6a97d3-33f3-4e22-9288-47615f9dd0ea req-f185cfa2-7993-4bc2-bc93-c4476df92d54 service nova] Lock "c6aae433-005c-4b50-9006-d71bca0f8368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:33:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-6f6a97d3-33f3-4e22-9288-47615f9dd0ea req-f185cfa2-7993-4bc2-bc93-c4476df92d54 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] No waiting events found dispatching network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:33:56 user nova-compute[75017]: WARNING nova.compute.manager [req-6f6a97d3-33f3-4e22-9288-47615f9dd0ea req-f185cfa2-7993-4bc2-bc93-c4476df92d54 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received unexpected event network-vif-plugged-bc2ab399-b4af-40af-b756-74b48450eb12 for instance with vm_state deleted and task_state None.
Oct 30 09:33:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-6f6a97d3-33f3-4e22-9288-47615f9dd0ea req-f185cfa2-7993-4bc2-bc93-c4476df92d54 service nova] [instance: c6aae433-005c-4b50-9006-d71bca0f8368] Received event network-vif-deleted-bc2ab399-b4af-40af-b756-74b48450eb12 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:33:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:33:59 user nova-compute[75017]: DEBUG nova.compute.manager [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:33:59 user nova-compute[75017]: INFO nova.compute.manager [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] instance snapshotting
Oct 30 09:33:59 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Beginning live snapshot process
Oct 30 09:34:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json -f qcow2 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json -f qcow2 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9u_07uy3/dce21b8df6554428bb49be1f932e3897.delta 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9u_07uy3/dce21b8df6554428bb49be1f932e3897.delta 1073741824" returned: 0 in 0.053s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:00 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 09:34:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75017) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 09:34:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75017) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 09:34:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 09:34:02 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:34:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9u_07uy3/dce21b8df6554428bb49be1f932e3897.delta /opt/stack/data/nova/instances/snapshots/tmp9u_07uy3/dce21b8df6554428bb49be1f932e3897 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9u_07uy3/dce21b8df6554428bb49be1f932e3897.delta /opt/stack/data/nova/instances/snapshots/tmp9u_07uy3/dce21b8df6554428bb49be1f932e3897" returned: 0 in 0.516s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:02 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Snapshot extracted, beginning image upload
Oct 30 09:34:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:34:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Snapshot image upload complete
Oct 30 09:34:05 user nova-compute[75017]: INFO nova.compute.manager [None req-bed98c62-0720-446d-9411-039dd8b4f7cb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Took 5.18 seconds to snapshot the instance on the hypervisor.
Oct 30 09:34:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:34:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:07 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:34:07 user nova-compute[75017]: INFO nova.compute.claims [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Claim successful on node user
Oct 30 09:34:08 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG nova.network.neutron [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:34:08 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:34:08 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG nova.policy [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4829e2b76b044474a226ba8a6a48a393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cb9c81a01a44079a469bb6aea845cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:34:08 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Creating image(s)
Oct 30 09:34:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "/opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "/opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "/opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "49c635040233db6138d31f075b64e84f2cc39d0f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "49c635040233db6138d31f075b64e84f2cc39d0f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:09 user nova-compute[75017]: DEBUG nova.network.neutron [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Successfully created port: ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:34:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f.part --force-share --output=json" returned: 0 in 0.217s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:09 user nova-compute[75017]: DEBUG nova.virt.images [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] ff999978-e686-436e-bb9d-f3437e5bc3ba was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:34:09 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:34:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f.part /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f.part /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f.converted" returned: 0 in 0.493s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:09 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "49c635040233db6138d31f075b64e84f2cc39d0f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.864s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.network.neutron [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Successfully updated port: ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquired lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.network.neutron [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.compute.manager [req-675e1835-36ef-44e1-8fb5-8dee1d4435aa req-8e74e8ce-8f34-4d54-a176-429aad85278f service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received event network-changed-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.compute.manager [req-675e1835-36ef-44e1-8fb5-8dee1d4435aa req-8e74e8ce-8f34-4d54-a176-429aad85278f service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Refreshing instance network info cache due to event network-changed-ae934675-b72b-4659-90cd-86948c8b01b2. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-675e1835-36ef-44e1-8fb5-8dee1d4435aa req-8e74e8ce-8f34-4d54-a176-429aad85278f service nova] Acquiring lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f --force-share --output=json" returned: 0 in 0.228s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "49c635040233db6138d31f075b64e84f2cc39d0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "49c635040233db6138d31f075b64e84f2cc39d0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.network.neutron [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f,backing_fmt=raw /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f,backing_fmt=raw /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk 1073741824" returned: 0 in 0.050s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "49c635040233db6138d31f075b64e84f2cc39d0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.network.neutron [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updating instance_info_cache with network_info: [{"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Releasing lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Instance network_info: |[{"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-675e1835-36ef-44e1-8fb5-8dee1d4435aa req-8e74e8ce-8f34-4d54-a176-429aad85278f service nova] Acquired lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.network.neutron [req-675e1835-36ef-44e1-8fb5-8dee1d4435aa req-8e74e8ce-8f34-4d54-a176-429aad85278f service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Refreshing network info cache for port ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Ensure instance console log exists: /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Start _get_guest_xml network_info=[{"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b55d915398867d917c71e27f8e51cd5b',container_format='bare',created_at=2023-10-30T09:34:00Z,direct_url=<?>,disk_format='qcow2',id=ff999978-e686-436e-bb9d-f3437e5bc3ba,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1273246604',owner='10cb9c81a01a44079a469bb6aea845cc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T09:34:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'ff999978-e686-436e-bb9d-f3437e5bc3ba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:34:10 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:34:10 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b55d915398867d917c71e27f8e51cd5b',container_format='bare',created_at=2023-10-30T09:34:00Z,direct_url=<?>,disk_format='qcow2',id=ff999978-e686-436e-bb9d-f3437e5bc3ba,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1273246604',owner='10cb9c81a01a44079a469bb6aea845cc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T09:34:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-180673827',display_name='tempest-TestStampPattern-server-180673827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-180673827',id=40,image_ref='ff999978-e686-436e-bb9d-f3437e5bc3ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn4YBrWT+oXcMf0FPfsei5t/kRlFe3zwa88mbl5XB02JUbxKsTrVMHZBihz5S+PsRa4KWSStTjiCQfgLkYHyr/M3IBxUs5GEFYj004rG0vhFW1t4jvvI3x4alcHZMrm+A==',key_name='tempest-TestStampPattern-619789116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10cb9c81a01a44079a469bb6aea845cc',ramdisk_id='',reservation_id='r-q763n0ma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bfbdfdec-fa8f-4c30-999b-8975cbfc37ef',image_min_disk='1',image_min_ram='0',image_owner_id='10cb9c81a01a44079a469bb6aea845cc',image_owner_project_name='tempest-TestStampPattern-1711313576',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1711313576-project-member',image_user_id='4829e2b76b044474a226ba8a6a48a393',network_allocated='True',owner_project_name='tempest-TestStampPattern-1711313576',owner_user_name='tempest-TestStampPattern-1711313576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:34:08Z,user_data=None,user_id='4829e2b76b044474a226ba8a6a48a393',uuid=f85c4f61-41d2-43d5-9984-19419aa31e3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converting VIF {"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:91:6c,bridge_name='br-int',has_traffic_filtering=True,id=ae934675-b72b-4659-90cd-86948c8b01b2,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae934675-b7') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'pci_devices' on Instance uuid f85c4f61-41d2-43d5-9984-19419aa31e3b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:34:10 user nova-compute[75017]:   <uuid>f85c4f61-41d2-43d5-9984-19419aa31e3b</uuid>
Oct 30 09:34:10 user nova-compute[75017]:   <name>instance-00000028</name>
Oct 30 09:34:10 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:34:10 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:34:10 user nova-compute[75017]:   <metadata>
Oct 30 09:34:10 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:34:10 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:34:10 user nova-compute[75017]:       <nova:name>tempest-TestStampPattern-server-180673827</nova:name>
Oct 30 09:34:10 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:34:10</nova:creationTime>
Oct 30 09:34:10 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:34:10 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:34:10 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:34:10 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:34:10 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:34:10 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:34:10 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:34:10 user nova-compute[75017]:       <nova:owner>
Oct 30 09:34:10 user nova-compute[75017]:         <nova:user uuid="4829e2b76b044474a226ba8a6a48a393">tempest-TestStampPattern-1711313576-project-member</nova:user>
Oct 30 09:34:10 user nova-compute[75017]:         <nova:project uuid="10cb9c81a01a44079a469bb6aea845cc">tempest-TestStampPattern-1711313576</nova:project>
Oct 30 09:34:10 user nova-compute[75017]:       </nova:owner>
Oct 30 09:34:10 user nova-compute[75017]:       <nova:root type="image" uuid="ff999978-e686-436e-bb9d-f3437e5bc3ba"/>
Oct 30 09:34:10 user nova-compute[75017]:       <nova:ports>
Oct 30 09:34:10 user nova-compute[75017]:         <nova:port uuid="ae934675-b72b-4659-90cd-86948c8b01b2">
Oct 30 09:34:10 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 09:34:10 user nova-compute[75017]:         </nova:port>
Oct 30 09:34:10 user nova-compute[75017]:       </nova:ports>
Oct 30 09:34:10 user nova-compute[75017]:     </nova:instance>
Oct 30 09:34:10 user nova-compute[75017]:   </metadata>
Oct 30 09:34:10 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:34:10 user nova-compute[75017]:     <system>
Oct 30 09:34:10 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:34:10 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:34:10 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:34:10 user nova-compute[75017]:       <entry name="serial">f85c4f61-41d2-43d5-9984-19419aa31e3b</entry>
Oct 30 09:34:10 user nova-compute[75017]:       <entry name="uuid">f85c4f61-41d2-43d5-9984-19419aa31e3b</entry>
Oct 30 09:34:10 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:34:10 user nova-compute[75017]:     </system>
Oct 30 09:34:10 user nova-compute[75017]:   </sysinfo>
Oct 30 09:34:10 user nova-compute[75017]:   <os>
Oct 30 09:34:10 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:34:10 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:34:10 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:34:10 user nova-compute[75017]:   </os>
Oct 30 09:34:10 user nova-compute[75017]:   <features>
Oct 30 09:34:10 user nova-compute[75017]:     <acpi/>
Oct 30 09:34:10 user nova-compute[75017]:     <apic/>
Oct 30 09:34:10 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:34:10 user nova-compute[75017]:   </features>
Oct 30 09:34:10 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:34:10 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:34:10 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:34:10 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:34:10 user nova-compute[75017]:   </clock>
Oct 30 09:34:10 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:34:10 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:34:10 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:34:10 user nova-compute[75017]:   </cpu>
Oct 30 09:34:10 user nova-compute[75017]:   <devices>
Oct 30 09:34:10 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:34:10 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:34:10 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk"/>
Oct 30 09:34:10 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:34:10 user nova-compute[75017]:     </disk>
Oct 30 09:34:10 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:34:10 user nova-compute[75017]:       <mac address="fa:16:3e:f9:91:6c"/>
Oct 30 09:34:10 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:34:10 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:34:10 user nova-compute[75017]:       <target dev="tapae934675-b7"/>
Oct 30 09:34:10 user nova-compute[75017]:     </interface>
Oct 30 09:34:10 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:34:10 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/console.log" append="off"/>
Oct 30 09:34:10 user nova-compute[75017]:     </serial>
Oct 30 09:34:10 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:34:10 user nova-compute[75017]:     <video>
Oct 30 09:34:10 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:34:10 user nova-compute[75017]:     </video>
Oct 30 09:34:10 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:34:10 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:34:10 user nova-compute[75017]:     </rng>
Oct 30 09:34:10 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:34:10 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:34:10 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:34:10 user nova-compute[75017]:     </memballoon>
Oct 30 09:34:10 user nova-compute[75017]:   </devices>
Oct 30 09:34:10 user nova-compute[75017]: </domain>
Oct 30 09:34:10 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-180673827',display_name='tempest-TestStampPattern-server-180673827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-180673827',id=40,image_ref='ff999978-e686-436e-bb9d-f3437e5bc3ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn4YBrWT+oXcMf0FPfsei5t/kRlFe3zwa88mbl5XB02JUbxKsTrVMHZBihz5S+PsRa4KWSStTjiCQfgLkYHyr/M3IBxUs5GEFYj004rG0vhFW1t4jvvI3x4alcHZMrm+A==',key_name='tempest-TestStampPattern-619789116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10cb9c81a01a44079a469bb6aea845cc',ramdisk_id='',reservation_id='r-q763n0ma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bfbdfdec-fa8f-4c30-999b-8975cbfc37ef',image_min_disk='1',image_min_ram='0',image_owner_id='10cb9c81a01a44079a469bb6aea845cc',image_owner_project_name='tempest-TestStampPattern-1711313576',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1711313576-project-member',image_user_id='4829e2b76b044474a226ba8a6a48a393',network_allocated='True',owner_project_name='tempest-TestStampPattern-1711313576',owner_user_name='tempest-TestStampPattern-1711313576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:34:08Z,user_data=None,user_id='4829e2b76b044474a226ba8a6a48a393',uuid=f85c4f61-41d2-43d5-9984-19419aa31e3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converting VIF {"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:91:6c,bridge_name='br-int',has_traffic_filtering=True,id=ae934675-b72b-4659-90cd-86948c8b01b2,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae934675-b7') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG os_vif [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:91:6c,bridge_name='br-int',has_traffic_filtering=True,id=ae934675-b72b-4659-90cd-86948c8b01b2,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae934675-b7') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cae422d-68f5-5dc3-8a0c-fa6f61dfa506', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae934675-b7, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae934675-b7, col_values=(('qos', UUID('84d985ce-1513-4022-9a40-e1e43d43baf5')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae934675-b7, col_values=(('external_ids', {'iface-id': 'ae934675-b72b-4659-90cd-86948c8b01b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:91:6c', 'vm-uuid': 'f85c4f61-41d2-43d5-9984-19419aa31e3b'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:34:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:10 user nova-compute[75017]: INFO os_vif [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:91:6c,bridge_name='br-int',has_traffic_filtering=True,id=ae934675-b72b-4659-90cd-86948c8b01b2,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae934675-b7')
Oct 30 09:34:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:34:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No VIF found with MAC fa:16:3e:f9:91:6c, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:34:11 user nova-compute[75017]: DEBUG nova.network.neutron [req-675e1835-36ef-44e1-8fb5-8dee1d4435aa req-8e74e8ce-8f34-4d54-a176-429aad85278f service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updated VIF entry in instance network info cache for port ae934675-b72b-4659-90cd-86948c8b01b2. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:34:11 user nova-compute[75017]: DEBUG nova.network.neutron [req-675e1835-36ef-44e1-8fb5-8dee1d4435aa req-8e74e8ce-8f34-4d54-a176-429aad85278f service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updating instance_info_cache with network_info: [{"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:34:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-675e1835-36ef-44e1-8fb5-8dee1d4435aa req-8e74e8ce-8f34-4d54-a176-429aad85278f service nova] Releasing lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:34:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:13 user nova-compute[75017]: DEBUG nova.compute.manager [req-bda7e5f1-1f7c-4c43-a7c9-99560e2e55d3 req-4fe822b3-1bcf-440e-ba0e-e5ec08828a3c service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received event network-vif-plugged-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bda7e5f1-1f7c-4c43-a7c9-99560e2e55d3 req-4fe822b3-1bcf-440e-ba0e-e5ec08828a3c service nova] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bda7e5f1-1f7c-4c43-a7c9-99560e2e55d3 req-4fe822b3-1bcf-440e-ba0e-e5ec08828a3c service nova] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bda7e5f1-1f7c-4c43-a7c9-99560e2e55d3 req-4fe822b3-1bcf-440e-ba0e-e5ec08828a3c service nova] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:13 user nova-compute[75017]: DEBUG nova.compute.manager [req-bda7e5f1-1f7c-4c43-a7c9-99560e2e55d3 req-4fe822b3-1bcf-440e-ba0e-e5ec08828a3c service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] No waiting events found dispatching network-vif-plugged-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:34:13 user nova-compute[75017]: WARNING nova.compute.manager [req-bda7e5f1-1f7c-4c43-a7c9-99560e2e55d3 req-4fe822b3-1bcf-440e-ba0e-e5ec08828a3c service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received unexpected event network-vif-plugged-ae934675-b72b-4659-90cd-86948c8b01b2 for instance with vm_state building and task_state spawning.
Oct 30 09:34:13 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:34:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:34:14 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Instance spawned successfully.
Oct 30 09:34:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:34:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:34:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:34:15 user nova-compute[75017]: INFO nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Took 6.72 seconds to spawn the instance on the hypervisor.
Oct 30 09:34:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:34:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-890d69fa-fb9a-4ebf-98ce-5c798b5cbb92 req-4625bfcf-5ceb-480a-a3c9-7d01cbdd278a service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received event network-vif-plugged-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-890d69fa-fb9a-4ebf-98ce-5c798b5cbb92 req-4625bfcf-5ceb-480a-a3c9-7d01cbdd278a service nova] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-890d69fa-fb9a-4ebf-98ce-5c798b5cbb92 req-4625bfcf-5ceb-480a-a3c9-7d01cbdd278a service nova] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-890d69fa-fb9a-4ebf-98ce-5c798b5cbb92 req-4625bfcf-5ceb-480a-a3c9-7d01cbdd278a service nova] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-890d69fa-fb9a-4ebf-98ce-5c798b5cbb92 req-4625bfcf-5ceb-480a-a3c9-7d01cbdd278a service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] No waiting events found dispatching network-vif-plugged-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:34:15 user nova-compute[75017]: WARNING nova.compute.manager [req-890d69fa-fb9a-4ebf-98ce-5c798b5cbb92 req-4625bfcf-5ceb-480a-a3c9-7d01cbdd278a service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received unexpected event network-vif-plugged-ae934675-b72b-4659-90cd-86948c8b01b2 for instance with vm_state building and task_state spawning.
Oct 30 09:34:15 user nova-compute[75017]: INFO nova.compute.manager [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Took 7.55 seconds to build instance.
Oct 30 09:34:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1ad45535-008d-4723-921d-9768fb06ca30 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.649s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:22 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:24 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:28 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:28 user nova-compute[75017]: INFO nova.compute.manager [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Rescuing
Oct 30 09:34:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:34:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquired lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:34:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updating instance_info_cache with network_info: [{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Releasing lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8d5581ca-660e-4823-ba81-62dd51c36de3 req-f80f4caa-d5c2-4354-89a6-58f0919f35bd service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-unplugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8d5581ca-660e-4823-ba81-62dd51c36de3 req-f80f4caa-d5c2-4354-89a6-58f0919f35bd service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8d5581ca-660e-4823-ba81-62dd51c36de3 req-f80f4caa-d5c2-4354-89a6-58f0919f35bd service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8d5581ca-660e-4823-ba81-62dd51c36de3 req-f80f4caa-d5c2-4354-89a6-58f0919f35bd service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8d5581ca-660e-4823-ba81-62dd51c36de3 req-f80f4caa-d5c2-4354-89a6-58f0919f35bd service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-unplugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:34:29 user nova-compute[75017]: WARNING nova.compute.manager [req-8d5581ca-660e-4823-ba81-62dd51c36de3 req-f80f4caa-d5c2-4354-89a6-58f0919f35bd service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-unplugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state active and task_state rescuing.
Oct 30 09:34:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Instance destroyed successfully.
Oct 30 09:34:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Attempting a stable device rescue
Oct 30 09:34:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75017) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 09:34:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Instance directory exists: not creating {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 09:34:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Creating image(s)
Oct 30 09:34:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "/opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "/opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "/opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:30 user nova-compute[75017]: DEBUG nova.objects.instance [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "00409fd0d8d32e703080b707084d4c0a01f43623" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "00409fd0d8d32e703080b707084d4c0a01f43623" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 1.052s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG nova.objects.instance [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'flavor' on Instance uuid 85a15494-ab66-4692-949f-be1b0248971c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG nova.virt.images [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] c98aa70c-4d5f-4b3b-bfa7-f16f84a184f0 was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623.part /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb3cfd8-a544-41f5-8f70-b4ed4140cfc9 req-ae3b6757-d517-43f7-a0cd-1ca48fe46928 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb3cfd8-a544-41f5-8f70-b4ed4140cfc9 req-ae3b6757-d517-43f7-a0cd-1ca48fe46928 service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb3cfd8-a544-41f5-8f70-b4ed4140cfc9 req-ae3b6757-d517-43f7-a0cd-1ca48fe46928 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bcb3cfd8-a544-41f5-8f70-b4ed4140cfc9 req-ae3b6757-d517-43f7-a0cd-1ca48fe46928 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-bcb3cfd8-a544-41f5-8f70-b4ed4140cfc9 req-ae3b6757-d517-43f7-a0cd-1ca48fe46928 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:34:31 user nova-compute[75017]: WARNING nova.compute.manager [req-bcb3cfd8-a544-41f5-8f70-b4ed4140cfc9 req-ae3b6757-d517-43f7-a0cd-1ca48fe46928 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state active and task_state rescuing.
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:32 user nova-compute[75017]: INFO nova.compute.manager [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Attaching volume 18555288-52aa-4fe7-8b00-d0808706fd62 to /dev/vdb
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623.part /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623.converted" returned: 0 in 0.688s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG os_brick.utils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[093e4401-8c06-49ce-a1a4-e04997795bdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[264827a9-eed4-49a4-9100-ebd8a3eb3567]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9920f9d-9b64-449b-8c98-69803ffcaf7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fcdaa7-5421-4658-a3bf-348fb2655a22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "00409fd0d8d32e703080b707084d4c0a01f43623" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.132s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:34:32 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[75454a7d-17be-4370-8ff4-57e2f7175ebf]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG os_brick.utils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating existing volume attachment record: d5aa182c-3a2c-4463-9716-716c54d9d82c {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "00409fd0d8d32e703080b707084d4c0a01f43623" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "00409fd0d8d32e703080b707084d4c0a01f43623" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623 --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623,backing_fmt=raw /opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.rescue {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623,backing_fmt=raw /opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.rescue" returned: 0 in 0.207s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "00409fd0d8d32e703080b707084d4c0a01f43623" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.400s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'migration_context' on Instance uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<5279c2eb-3996-4b46-8925-81a5d7022c5f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Start _get_guest_xml network_info=[{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "vif_mac": "fa:16:3e:fe:06:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c98aa70c-4d5f-4b3b-bfa7-f16f84a184f0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msADnxTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '5279c2eb-3996-4b46-8925-81a5d7022c5f', 'attached_at': '', 'detached_at': '', 'volume_id': '0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 'serial': '0ca80d7d-9669-44b0-a3bf-5ec837f3acb0'}, 'disk_bus': 'virtio', 'attachment_id': '75179c90-6f13-4bb4-ac2f-af6aadad3783', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'resources' on Instance uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<5279c2eb-3996-4b46-8925-81a5d7022c5f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'numa_topology' on Instance uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<5279c2eb-3996-4b46-8925-81a5d7022c5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:34:33 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:34:33 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<5279c2eb-3996-4b46-8925-81a5d7022c5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msADnxTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:34:33 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:34:33 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:34:33 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[75012d9d-ed52-4a6a-8fc3-6242d2e3e0bd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = msADnxTO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 30 09:34:33 user nova-compute[75017]: node.name = iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:34:33 user nova-compute[75017]: node.tpgt = -1
Oct 30 09:34:33 user nova-compute[75017]: node.startup = automatic
Oct 30 09:34:33 user nova-compute[75017]: node.leading_login = No
Oct 30 09:34:33 user nova-compute[75017]: iface.iscsi_ifacename = default
Oct 30 09:34:33 user nova-compute[75017]: iface.net_ifacename = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.ipaddress = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.prefix_len = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.hwaddress = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.transport_name = tcp
Oct 30 09:34:33 user nova-compute[75017]: iface.initiatorname = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.state = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.vlan_id = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.vlan_priority = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.vlan_state = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.iface_num = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.mtu = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.port = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.bootproto = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.subnet_mask = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.gateway = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.dhcp_alt_client_id_state = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.dhcp_alt_client_id = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.dhcp_dns = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.dhcp_learn_iqn = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.dhcp_req_vendor_id_state = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.dhcp_vendor_id_state = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.dhcp_vendor_id = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.dhcp_slp_da = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.fragmentation = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.gratuitous_arp = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.incoming_forwarding = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.tos_state = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.tos = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.ttl = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.delayed_ack = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.tcp_nagle = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.tcp_wsf_state = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.tcp_wsf = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.tcp_timer_scale = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.tcp_timestamp = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.redirect = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.def_task_mgmt_timeout = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.header_digest = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.data_digest = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.immediate_data = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.initial_r2t = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.data_seq_inorder = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.data_pdu_inorder = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.erl = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.max_receive_data_len = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.first_burst_len = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.max_outstanding_r2t = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.max_burst_len = 0
Oct 30 09:34:33 user nova-compute[75017]: iface.chap_auth = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.bidi_chap = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.strict_login_compliance = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.discovery_auth = <empty>
Oct 30 09:34:33 user nova-compute[75017]: iface.discovery_logout = <empty>
Oct 30 09:34:33 user nova-compute[75017]: node.discovery_address = <empty>
Oct 30 09:34:33 user nova-compute[75017]: node.discovery_port = 0
Oct 30 09:34:33 user nova-compute[75017]: node.discovery_type = static
Oct 30 09:34:33 user nova-compute[75017]: node.session.initial_cmdsn = 0
Oct 30 09:34:33 user nova-compute[75017]: node.session.initial_login_retry_max = 8
Oct 30 09:34:33 user nova-compute[75017]: node.session.xmit_thread_priority = -20
Oct 30 09:34:33 user nova-compute[75017]: node.session.cmds_max = 128
Oct 30 09:34:33 user nova-compute[75017]: node.session.queue_depth = 32
Oct 30 09:34:33 user nova-compute[75017]: node.session.nr_sessions = 1
Oct 30 09:34:33 user nova-compute[75017]: node.session.auth.authmethod = CHAP
Oct 30 09:34:33 user nova-compute[75017]: node.session.auth.username = msADnxTO
Oct 30 09:34:33 user nova-compute[75017]: node.session.auth.password = ***
Oct 30 09:34:33 user nova-compute[75017]: node.session.auth.username_in = <empty>
Oct 30 09:34:33 user nova-compute[75017]: node.session.auth.password_in = <empty>
Oct 30 09:34:33 user nova-compute[75017]: node.session.auth.chap_algs = MD5
Oct 30 09:34:33 user nova-compute[75017]: node.session.timeo.replacement_timeout = 120
Oct 30 09:34:33 user nova-compute[75017]: node.session.err_timeo.abort_timeout = 15
Oct 30 09:34:33 user nova-compute[75017]: node.session.err_timeo.lu_reset_timeout = 30
Oct 30 09:34:33 user nova-compute[75017]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 30 09:34:33 user nova-compute[75017]: node.session.err_timeo.host_reset_timeout = 60
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.FastAbort = Yes
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.InitialR2T = No
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.ImmediateData = Yes
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.FirstBurstLength = 262144
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.MaxBurstLength = 16776192
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.DefaultTime2Retain = 0
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.DefaultTime2Wait = 2
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.MaxConnections = 1
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 30 09:34:33 user nova-compute[75017]: node.session.iscsi.ERL = 0
Oct 30 09:34:33 user nova-compute[75017]: node.session.scan = manual
Oct 30 09:34:33 user nova-compute[75017]: node.session.reopen_max = 0
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].address = 172.16.0.220
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].port = 3260
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].startup = manual
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].tcp.window_size = 524288
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].tcp.type_of_service = 0
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].timeo.logout_timeout = 15
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].timeo.login_timeout = 15
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].timeo.auth_timeout = 45
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].timeo.noop_out_interval = 5
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].timeo.noop_out_timeout = 5
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].iscsi.HeaderDigest = None
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].iscsi.DataDigest = None
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].iscsi.IFMarker = No
Oct 30 09:34:33 user nova-compute[75017]: node.conn[0].iscsi.OFMarker = No
Oct 30 09:34:33 user nova-compute[75017]: # END RECORD
Oct 30 09:34:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e79fe74-6dbc-4788-8355-9bc8d86637ca]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:34:33 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8254MB free_disk=24.985897064208984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4478d2-5c59-4882-9458-f0e2ae86792e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msADnxTO {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msADnxTO" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e7c18-96aa-437a-9374-591739b5cf66]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'msADnxTO'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ba8b7c-e654-4fc0-9c23-33abfbf39932]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f40a0f-1f33-4bdf-867b-16463f2fde26]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:34:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:34:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.521s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] HCTL ('36', '0', '0', 0) found on session 39 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd865fb-d660-4615-a692-baf338fd90f6]: (4, ('0 0 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching for a device in session 39 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msADnxTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.545s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] <== connect_volume: return (547ms) {'type': 'block', 'scsi_wwn': '23064336631316635', 'path': '/dev/sde'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064336631316635', 'path': '/dev/sde'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2128039297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2128039297',id=39,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-3b9q1b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:33:10Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=5279c2eb-3996-4b46-8925-81a5d7022c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "vif_mac": "fa:16:3e:fe:06:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "vif_mac": "fa:16:3e:fe:06:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:06:69,bridge_name='br-int',has_traffic_filtering=True,id=b857c2d6-780f-4bb7-a3cc-722b83e893d4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb857c2d6-78') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'pci_devices' on Instance uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 85a15494-ab66-4692-949f-be1b0248971c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f85c4f61-41d2-43d5-9984-19419aa31e3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.objects.base [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<5279c2eb-3996-4b46-8925-81a5d7022c5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:34:33 user nova-compute[75017]:   <uuid>5279c2eb-3996-4b46-8925-81a5d7022c5f</uuid>
Oct 30 09:34:33 user nova-compute[75017]:   <name>instance-00000027</name>
Oct 30 09:34:33 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:34:33 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:34:33 user nova-compute[75017]:   <metadata>
Oct 30 09:34:33 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:34:33 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:34:33 user nova-compute[75017]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2128039297</nova:name>
Oct 30 09:34:33 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:34:33</nova:creationTime>
Oct 30 09:34:33 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:34:33 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:34:33 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:34:33 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:34:33 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:34:33 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:34:33 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:34:33 user nova-compute[75017]:       <nova:owner>
Oct 30 09:34:33 user nova-compute[75017]:         <nova:user uuid="d734d26551bc41a585d443a24fac0cd8">tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member</nova:user>
Oct 30 09:34:33 user nova-compute[75017]:         <nova:project uuid="76ba6409f82447ba9d0f4f56eef88b1d">tempest-ServerBootFromVolumeStableRescueTest-1506388181</nova:project>
Oct 30 09:34:33 user nova-compute[75017]:       </nova:owner>
Oct 30 09:34:33 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:34:33 user nova-compute[75017]:       <nova:ports>
Oct 30 09:34:33 user nova-compute[75017]:         <nova:port uuid="b857c2d6-780f-4bb7-a3cc-722b83e893d4">
Oct 30 09:34:33 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:34:33 user nova-compute[75017]:         </nova:port>
Oct 30 09:34:33 user nova-compute[75017]:       </nova:ports>
Oct 30 09:34:33 user nova-compute[75017]:     </nova:instance>
Oct 30 09:34:33 user nova-compute[75017]:   </metadata>
Oct 30 09:34:33 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:34:33 user nova-compute[75017]:     <system>
Oct 30 09:34:33 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:34:33 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:34:33 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:34:33 user nova-compute[75017]:       <entry name="serial">5279c2eb-3996-4b46-8925-81a5d7022c5f</entry>
Oct 30 09:34:33 user nova-compute[75017]:       <entry name="uuid">5279c2eb-3996-4b46-8925-81a5d7022c5f</entry>
Oct 30 09:34:33 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:34:33 user nova-compute[75017]:     </system>
Oct 30 09:34:33 user nova-compute[75017]:   </sysinfo>
Oct 30 09:34:33 user nova-compute[75017]:   <os>
Oct 30 09:34:33 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:34:33 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:34:33 user nova-compute[75017]:   </os>
Oct 30 09:34:33 user nova-compute[75017]:   <features>
Oct 30 09:34:33 user nova-compute[75017]:     <acpi/>
Oct 30 09:34:33 user nova-compute[75017]:     <apic/>
Oct 30 09:34:33 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:34:33 user nova-compute[75017]:   </features>
Oct 30 09:34:33 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:34:33 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:34:33 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:34:33 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:34:33 user nova-compute[75017]:   </clock>
Oct 30 09:34:33 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:34:33 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:34:33 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:34:33 user nova-compute[75017]:   </cpu>
Oct 30 09:34:33 user nova-compute[75017]:   <devices>
Oct 30 09:34:33 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:34:33 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:34:33 user nova-compute[75017]:       <source dev="/dev/sde"/>
Oct 30 09:34:33 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:34:33 user nova-compute[75017]:       <serial>0ca80d7d-9669-44b0-a3bf-5ec837f3acb0</serial>
Oct 30 09:34:33 user nova-compute[75017]:     </disk>
Oct 30 09:34:33 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:34:33 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:34:33 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.rescue"/>
Oct 30 09:34:33 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:34:33 user nova-compute[75017]:       <boot order="1"/>
Oct 30 09:34:33 user nova-compute[75017]:     </disk>
Oct 30 09:34:33 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:34:33 user nova-compute[75017]:       <mac address="fa:16:3e:fe:06:69"/>
Oct 30 09:34:33 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:34:33 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:34:33 user nova-compute[75017]:       <target dev="tapb857c2d6-78"/>
Oct 30 09:34:33 user nova-compute[75017]:     </interface>
Oct 30 09:34:33 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:34:33 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/console.log" append="off"/>
Oct 30 09:34:33 user nova-compute[75017]:     </serial>
Oct 30 09:34:33 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:34:33 user nova-compute[75017]:     <video>
Oct 30 09:34:33 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:34:33 user nova-compute[75017]:     </video>
Oct 30 09:34:33 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:34:33 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:34:33 user nova-compute[75017]:     </rng>
Oct 30 09:34:33 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:34:33 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:34:33 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:34:33 user nova-compute[75017]:     </memballoon>
Oct 30 09:34:33 user nova-compute[75017]:   </devices>
Oct 30 09:34:33 user nova-compute[75017]: </domain>
Oct 30 09:34:33 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:34:33 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Instance destroyed successfully.
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No VIF found with MAC fa:16:3e:fe:06:69, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:34:33 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:34:34 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:34:34 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:34:34 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:34:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-80c40201-a7a8-47cc-baec-4d0c53830efd req-05391194-63cd-471a-953e-5cbbd6abd6ae service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-80c40201-a7a8-47cc-baec-4d0c53830efd req-05391194-63cd-471a-953e-5cbbd6abd6ae service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-80c40201-a7a8-47cc-baec-4d0c53830efd req-05391194-63cd-471a-953e-5cbbd6abd6ae service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-80c40201-a7a8-47cc-baec-4d0c53830efd req-05391194-63cd-471a-953e-5cbbd6abd6ae service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-80c40201-a7a8-47cc-baec-4d0c53830efd req-05391194-63cd-471a-953e-5cbbd6abd6ae service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:34:35 user nova-compute[75017]: WARNING nova.compute.manager [req-80c40201-a7a8-47cc-baec-4d0c53830efd req-05391194-63cd-471a-953e-5cbbd6abd6ae service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state active and task_state rescuing.
Oct 30 09:34:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updating instance_info_cache with network_info: [{"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:34:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:34:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e3207945-239b-4c7f-bdd5-5ecabb62a09e tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:34:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-0bf98486-f6bf-4ed0-98ef-ad26ac039cd8 req-4fdf90d6-dd0f-49bc-a7c4-f683c7e7bed9 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0bf98486-f6bf-4ed0-98ef-ad26ac039cd8 req-4fdf90d6-dd0f-49bc-a7c4-f683c7e7bed9 service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0bf98486-f6bf-4ed0-98ef-ad26ac039cd8 req-4fdf90d6-dd0f-49bc-a7c4-f683c7e7bed9 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0bf98486-f6bf-4ed0-98ef-ad26ac039cd8 req-4fdf90d6-dd0f-49bc-a7c4-f683c7e7bed9 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-0bf98486-f6bf-4ed0-98ef-ad26ac039cd8 req-4fdf90d6-dd0f-49bc-a7c4-f683c7e7bed9 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:34:37 user nova-compute[75017]: WARNING nova.compute.manager [req-0bf98486-f6bf-4ed0-98ef-ad26ac039cd8 req-4fdf90d6-dd0f-49bc-a7c4-f683c7e7bed9 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state active and task_state rescuing.
Oct 30 09:34:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:34:42 user nova-compute[75017]: INFO nova.compute.claims [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Claim successful on node user
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.network.neutron [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:34:42 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.policy [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57fc74a319ac45e4b8f9f14b172d5e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d796755933441bfaff1fb821cc2ad9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:34:42 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Creating image(s)
Oct 30 09:34:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.281s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.242s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk 1073741824" returned: 0 in 0.061s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG nova.network.neutron [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Successfully created port: f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.252s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:34:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Cannot resize image /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Ensure instance console log exists: /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Successfully updated port: f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquired lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-f33edac0-8d89-4a51-90d5-95530e6ddf94 req-c93becc1-b7a7-433e-a004-44027bf6ed04 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-changed-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-f33edac0-8d89-4a51-90d5-95530e6ddf94 req-c93becc1-b7a7-433e-a004-44027bf6ed04 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Refreshing instance network info cache due to event network-changed-f6900dc8-c212-4060-8612-2b818a0912c5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f33edac0-8d89-4a51-90d5-95530e6ddf94 req-c93becc1-b7a7-433e-a004-44027bf6ed04 service nova] Acquiring lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:34:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updating instance_info_cache with network_info: [{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Releasing lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance network_info: |[{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f33edac0-8d89-4a51-90d5-95530e6ddf94 req-c93becc1-b7a7-433e-a004-44027bf6ed04 service nova] Acquired lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.network.neutron [req-f33edac0-8d89-4a51-90d5-95530e6ddf94 req-c93becc1-b7a7-433e-a004-44027bf6ed04 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Refreshing network info cache for port f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Start _get_guest_xml network_info=[{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:34:45 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:34:45 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1543175365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1543175365',id=41,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbhc/J2RhKcyGsZnv/Wb9vaAsjwFTR/gt63CZjK7jMYs0Mt3yrGE6pklvE8SdT3UJkNVsJU54rZHi2TbCExh8j+wG3OWvK8+6DAtlHMbL2ONsSjBVxMfGxh9RICXdcoBg==',key_name='tempest-keypair-1093075271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-6ol7na3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=d74e1f4c-b89b-4104-9611-0a2870f8d0ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.objects.instance [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'pci_devices' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:34:45 user nova-compute[75017]:   <uuid>d74e1f4c-b89b-4104-9611-0a2870f8d0ec</uuid>
Oct 30 09:34:45 user nova-compute[75017]:   <name>instance-00000029</name>
Oct 30 09:34:45 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:34:45 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:34:45 user nova-compute[75017]:   <metadata>
Oct 30 09:34:45 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:34:45 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:34:45 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1543175365</nova:name>
Oct 30 09:34:45 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:34:45</nova:creationTime>
Oct 30 09:34:45 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:34:45 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:34:45 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:34:45 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:34:45 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:34:45 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:34:45 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:34:45 user nova-compute[75017]:       <nova:owner>
Oct 30 09:34:45 user nova-compute[75017]:         <nova:user uuid="57fc74a319ac45e4b8f9f14b172d5e17">tempest-AttachVolumeShelveTestJSON-1409612729-project-member</nova:user>
Oct 30 09:34:45 user nova-compute[75017]:         <nova:project uuid="2d796755933441bfaff1fb821cc2ad9a">tempest-AttachVolumeShelveTestJSON-1409612729</nova:project>
Oct 30 09:34:45 user nova-compute[75017]:       </nova:owner>
Oct 30 09:34:45 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:34:45 user nova-compute[75017]:       <nova:ports>
Oct 30 09:34:45 user nova-compute[75017]:         <nova:port uuid="f6900dc8-c212-4060-8612-2b818a0912c5">
Oct 30 09:34:45 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 09:34:45 user nova-compute[75017]:         </nova:port>
Oct 30 09:34:45 user nova-compute[75017]:       </nova:ports>
Oct 30 09:34:45 user nova-compute[75017]:     </nova:instance>
Oct 30 09:34:45 user nova-compute[75017]:   </metadata>
Oct 30 09:34:45 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:34:45 user nova-compute[75017]:     <system>
Oct 30 09:34:45 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:34:45 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:34:45 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:34:45 user nova-compute[75017]:       <entry name="serial">d74e1f4c-b89b-4104-9611-0a2870f8d0ec</entry>
Oct 30 09:34:45 user nova-compute[75017]:       <entry name="uuid">d74e1f4c-b89b-4104-9611-0a2870f8d0ec</entry>
Oct 30 09:34:45 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:34:45 user nova-compute[75017]:     </system>
Oct 30 09:34:45 user nova-compute[75017]:   </sysinfo>
Oct 30 09:34:45 user nova-compute[75017]:   <os>
Oct 30 09:34:45 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:34:45 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:34:45 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:34:45 user nova-compute[75017]:   </os>
Oct 30 09:34:45 user nova-compute[75017]:   <features>
Oct 30 09:34:45 user nova-compute[75017]:     <acpi/>
Oct 30 09:34:45 user nova-compute[75017]:     <apic/>
Oct 30 09:34:45 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:34:45 user nova-compute[75017]:   </features>
Oct 30 09:34:45 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:34:45 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:34:45 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:34:45 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:34:45 user nova-compute[75017]:   </clock>
Oct 30 09:34:45 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:34:45 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:34:45 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:34:45 user nova-compute[75017]:   </cpu>
Oct 30 09:34:45 user nova-compute[75017]:   <devices>
Oct 30 09:34:45 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:34:45 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:34:45 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk"/>
Oct 30 09:34:45 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:34:45 user nova-compute[75017]:     </disk>
Oct 30 09:34:45 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:34:45 user nova-compute[75017]:       <mac address="fa:16:3e:8d:c5:27"/>
Oct 30 09:34:45 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:34:45 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:34:45 user nova-compute[75017]:       <target dev="tapf6900dc8-c2"/>
Oct 30 09:34:45 user nova-compute[75017]:     </interface>
Oct 30 09:34:45 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:34:45 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/console.log" append="off"/>
Oct 30 09:34:45 user nova-compute[75017]:     </serial>
Oct 30 09:34:45 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:34:45 user nova-compute[75017]:     <video>
Oct 30 09:34:45 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:34:45 user nova-compute[75017]:     </video>
Oct 30 09:34:45 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:34:45 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:34:45 user nova-compute[75017]:     </rng>
Oct 30 09:34:45 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:34:45 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:34:45 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:34:45 user nova-compute[75017]:     </memballoon>
Oct 30 09:34:45 user nova-compute[75017]:   </devices>
Oct 30 09:34:45 user nova-compute[75017]: </domain>
Oct 30 09:34:45 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1543175365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1543175365',id=41,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbhc/J2RhKcyGsZnv/Wb9vaAsjwFTR/gt63CZjK7jMYs0Mt3yrGE6pklvE8SdT3UJkNVsJU54rZHi2TbCExh8j+wG3OWvK8+6DAtlHMbL2ONsSjBVxMfGxh9RICXdcoBg==',key_name='tempest-keypair-1093075271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-6ol7na3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=d74e1f4c-b89b-4104-9611-0a2870f8d0ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG os_vif [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc770545-e9b1-5844-be98-e399347f9952', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6900dc8-c2, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6900dc8-c2, col_values=(('qos', UUID('719438c4-6c0d-4afb-b036-b8ed92fea222')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6900dc8-c2, col_values=(('external_ids', {'iface-id': 'f6900dc8-c212-4060-8612-2b818a0912c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:c5:27', 'vm-uuid': 'd74e1f4c-b89b-4104-9611-0a2870f8d0ec'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:45 user nova-compute[75017]: INFO os_vif [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2')
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] No VIF found with MAC fa:16:3e:8d:c5:27, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.network.neutron [req-f33edac0-8d89-4a51-90d5-95530e6ddf94 req-c93becc1-b7a7-433e-a004-44027bf6ed04 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updated VIF entry in instance network info cache for port f6900dc8-c212-4060-8612-2b818a0912c5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG nova.network.neutron [req-f33edac0-8d89-4a51-90d5-95530e6ddf94 req-c93becc1-b7a7-433e-a004-44027bf6ed04 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updating instance_info_cache with network_info: [{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:34:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f33edac0-8d89-4a51-90d5-95530e6ddf94 req-c93becc1-b7a7-433e-a004-44027bf6ed04 service nova] Releasing lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:34:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-2fe657b8-4823-4d7c-8218-12bf968dad37 req-c30f188c-7bac-44ce-848c-93db67afb21d service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2fe657b8-4823-4d7c-8218-12bf968dad37 req-c30f188c-7bac-44ce-848c-93db67afb21d service nova] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2fe657b8-4823-4d7c-8218-12bf968dad37 req-c30f188c-7bac-44ce-848c-93db67afb21d service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2fe657b8-4823-4d7c-8218-12bf968dad37 req-c30f188c-7bac-44ce-848c-93db67afb21d service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-2fe657b8-4823-4d7c-8218-12bf968dad37 req-c30f188c-7bac-44ce-848c-93db67afb21d service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] No waiting events found dispatching network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:34:47 user nova-compute[75017]: WARNING nova.compute.manager [req-2fe657b8-4823-4d7c-8218-12bf968dad37 req-c30f188c-7bac-44ce-848c-93db67afb21d service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received unexpected event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 for instance with vm_state building and task_state spawning.
Oct 30 09:34:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-a6670fbf-7cd9-4a55-b69a-c7d2edca146b req-9f0358db-a93b-429f-bc98-af4331daed1c service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a6670fbf-7cd9-4a55-b69a-c7d2edca146b req-9f0358db-a93b-429f-bc98-af4331daed1c service nova] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a6670fbf-7cd9-4a55-b69a-c7d2edca146b req-9f0358db-a93b-429f-bc98-af4331daed1c service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a6670fbf-7cd9-4a55-b69a-c7d2edca146b req-9f0358db-a93b-429f-bc98-af4331daed1c service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.compute.manager [req-a6670fbf-7cd9-4a55-b69a-c7d2edca146b req-9f0358db-a93b-429f-bc98-af4331daed1c service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] No waiting events found dispatching network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:34:49 user nova-compute[75017]: WARNING nova.compute.manager [req-a6670fbf-7cd9-4a55-b69a-c7d2edca146b req-9f0358db-a93b-429f-bc98-af4331daed1c service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received unexpected event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 for instance with vm_state building and task_state spawning.
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:34:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance spawned successfully.
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:34:49 user nova-compute[75017]: INFO nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Took 6.92 seconds to spawn the instance on the hypervisor.
Oct 30 09:34:49 user nova-compute[75017]: DEBUG nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:34:50 user nova-compute[75017]: INFO nova.compute.manager [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Took 7.91 seconds to build instance.
Oct 30 09:34:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-290a1295-c492-4ee1-b10a-afbab6a1a79d tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.089s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:34:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNKmWtHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:34:54 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:34:54 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:34:54 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6001e3f6-d5ef-4193-a28e-5bff8f02e1c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:34:54 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5a59ec-3e63-4702-8837-2b4f714970b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62] added
Oct 30 09:34:54 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3651d8a3-bf8e-4975-a2d1-c24c31e30a2c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[be697aad-7aa1-4d1d-9a12-5e1cf345b58d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QNKmWtHx {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QNKmWtHx" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f75c3c-fe85-42c3-9e7f-645d3c966e2f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QNKmWtHx'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[60447def-42be-4adc-9d94-e7ed129aa4a8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f1561e-5163-42cd-9e2c-f4eca91c9bc3]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:34:54 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:34:54 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3e15be-8bce-419a-a010-283137d973fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62, portal: 172.16.0.220,3260]
Oct 30 09:34:54 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62, portal: 172.16.0.220,3260] successful.
Oct 30 09:34:54 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c021a6-12ef-4a5e-8185-f1fdfac65693]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[858ecd71-40b0-497c-913b-0de0b1e7aa75]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:34:54 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:34:54 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:34:54 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:34:54 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce61af0-7f7e-440d-9915-b8a7a1af4b46]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:34:54 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNKmWtHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:34:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:34:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26436306361343335', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:34:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436306361343335', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:34:55 user nova-compute[75017]: DEBUG nova.objects.instance [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'flavor' on Instance uuid 85a15494-ab66-4692-949f-be1b0248971c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:34:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:34:55 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:34:55 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:34:55 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:34:55 user nova-compute[75017]:   <serial>18555288-52aa-4fe7-8b00-d0808706fd62</serial>
Oct 30 09:34:55 user nova-compute[75017]: </disk>
Oct 30 09:34:55 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:34:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:34:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:34:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] No VIF found with MAC fa:16:3e:7c:14:28, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:34:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:34:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-29c89df6-04ef-4d59-af21-a00326a8f754 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.158s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:35:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-7ef27b13-ebec-410a-8ca6-b71c29201ce4 req-cb90b525-6099-4f8c-986e-182089b2fab6 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:35:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-7ef27b13-ebec-410a-8ca6-b71c29201ce4 req-cb90b525-6099-4f8c-986e-182089b2fab6 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing instance network info cache due to event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:35:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7ef27b13-ebec-410a-8ca6-b71c29201ce4 req-cb90b525-6099-4f8c-986e-182089b2fab6 service nova] Acquiring lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:35:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7ef27b13-ebec-410a-8ca6-b71c29201ce4 req-cb90b525-6099-4f8c-986e-182089b2fab6 service nova] Acquired lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:35:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-7ef27b13-ebec-410a-8ca6-b71c29201ce4 req-cb90b525-6099-4f8c-986e-182089b2fab6 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:35:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-7ef27b13-ebec-410a-8ca6-b71c29201ce4 req-cb90b525-6099-4f8c-986e-182089b2fab6 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updated VIF entry in instance network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:35:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-7ef27b13-ebec-410a-8ca6-b71c29201ce4 req-cb90b525-6099-4f8c-986e-182089b2fab6 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating instance_info_cache with network_info: [{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:35:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7ef27b13-ebec-410a-8ca6-b71c29201ce4 req-cb90b525-6099-4f8c-986e-182089b2fab6 service nova] Releasing lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:35:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-a05c15fc-5b1e-42e5-b380-27e9d50bf8bc req-a619d52f-b1e2-49b6-a4ff-caba820f0c10 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:35:02 user nova-compute[75017]: DEBUG nova.compute.manager [req-a05c15fc-5b1e-42e5-b380-27e9d50bf8bc req-a619d52f-b1e2-49b6-a4ff-caba820f0c10 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing instance network info cache due to event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:35:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a05c15fc-5b1e-42e5-b380-27e9d50bf8bc req-a619d52f-b1e2-49b6-a4ff-caba820f0c10 service nova] Acquiring lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:35:02 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a05c15fc-5b1e-42e5-b380-27e9d50bf8bc req-a619d52f-b1e2-49b6-a4ff-caba820f0c10 service nova] Acquired lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:35:02 user nova-compute[75017]: DEBUG nova.network.neutron [req-a05c15fc-5b1e-42e5-b380-27e9d50bf8bc req-a619d52f-b1e2-49b6-a4ff-caba820f0c10 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:35:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-a05c15fc-5b1e-42e5-b380-27e9d50bf8bc req-a619d52f-b1e2-49b6-a4ff-caba820f0c10 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updated VIF entry in instance network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:35:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-a05c15fc-5b1e-42e5-b380-27e9d50bf8bc req-a619d52f-b1e2-49b6-a4ff-caba820f0c10 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating instance_info_cache with network_info: [{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:35:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a05c15fc-5b1e-42e5-b380-27e9d50bf8bc req-a619d52f-b1e2-49b6-a4ff-caba820f0c10 service nova] Releasing lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:35:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:35:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:35:03 user nova-compute[75017]: INFO nova.compute.manager [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Rebooting instance
Oct 30 09:35:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:35:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquired lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:35:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:35:04 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating instance_info_cache with network_info: [{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:35:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Releasing lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:35:04 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:35:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-b3f0dea1-6239-406b-b5d0-0f3dd7b0656e req-a64b3708-1dbc-4ee7-aa2f-94b175ac0361 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-unplugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:35:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b3f0dea1-6239-406b-b5d0-0f3dd7b0656e req-a64b3708-1dbc-4ee7-aa2f-94b175ac0361 service nova] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:35:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b3f0dea1-6239-406b-b5d0-0f3dd7b0656e req-a64b3708-1dbc-4ee7-aa2f-94b175ac0361 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:35:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b3f0dea1-6239-406b-b5d0-0f3dd7b0656e req-a64b3708-1dbc-4ee7-aa2f-94b175ac0361 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:35:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-b3f0dea1-6239-406b-b5d0-0f3dd7b0656e req-a64b3708-1dbc-4ee7-aa2f-94b175ac0361 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] No waiting events found dispatching network-vif-unplugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:35:07 user nova-compute[75017]: WARNING nova.compute.manager [req-b3f0dea1-6239-406b-b5d0-0f3dd7b0656e req-a64b3708-1dbc-4ee7-aa2f-94b175ac0361 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received unexpected event network-vif-unplugged-e060ba01-5902-47ef-b07a-900fd6891d5c for instance with vm_state active and task_state reboot_started.
Oct 30 09:35:07 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Instance shutdown successfully.
Oct 30 09:35:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-01647e3a-c158-473b-8662-4202a407bf5b req-a9986d2a-87ae-48c4-a513-5d9a70415aa2 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-01647e3a-c158-473b-8662-4202a407bf5b req-a9986d2a-87ae-48c4-a513-5d9a70415aa2 service nova] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-01647e3a-c158-473b-8662-4202a407bf5b req-a9986d2a-87ae-48c4-a513-5d9a70415aa2 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-01647e3a-c158-473b-8662-4202a407bf5b req-a9986d2a-87ae-48c4-a513-5d9a70415aa2 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-01647e3a-c158-473b-8662-4202a407bf5b req-a9986d2a-87ae-48c4-a513-5d9a70415aa2 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] No waiting events found dispatching network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:35:09 user nova-compute[75017]: WARNING nova.compute.manager [req-01647e3a-c158-473b-8662-4202a407bf5b req-a9986d2a-87ae-48c4-a513-5d9a70415aa2 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received unexpected event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c for instance with vm_state active and task_state reboot_started.
Oct 30 09:35:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] No waiting events found dispatching network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:35:11 user nova-compute[75017]: WARNING nova.compute.manager [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received unexpected event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c for instance with vm_state active and task_state reboot_started.
Oct 30 09:35:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG nova.compute.manager [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] No waiting events found dispatching network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:35:11 user nova-compute[75017]: WARNING nova.compute.manager [req-c3835ea3-e61b-4283-aeba-58b816e5d8ca req-d88912d0-3200-45cd-9dcf-b8a0cacb43f3 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received unexpected event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c for instance with vm_state active and task_state reboot_started.
Oct 30 09:35:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:11 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Instance running successfully.
Oct 30 09:35:11 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Instance soft rebooted successfully.
Oct 30 09:35:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:35:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b1c385b9-ac7e-4499-a7a6-dd2c3dc55685 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.031s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:35:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:23 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:35:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:35:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:35:26 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:35:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:35:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:35:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:35:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:35:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:35:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:35:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:35:30 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:35:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:35:33 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:35:33 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8025MB free_disk=24.831520080566406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 85a15494-ab66-4692-949f-be1b0248971c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f85c4f61-41d2-43d5-9984-19419aa31e3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d74e1f4c-b89b-4104-9611-0a2870f8d0ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:35:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:35:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:35:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:35:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:35:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:35:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:35:39 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updating instance_info_cache with network_info: [{"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:35:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:35:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:35:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:35:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:35:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:35:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-05dc846c-84c6-4831-9f6b-d4d6eda0d692 req-5570bfee-6250-4ca0-939e-73cc77a18149 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received event network-changed-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:35:59 user nova-compute[75017]: DEBUG nova.compute.manager [req-05dc846c-84c6-4831-9f6b-d4d6eda0d692 req-5570bfee-6250-4ca0-939e-73cc77a18149 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Refreshing instance network info cache due to event network-changed-ae934675-b72b-4659-90cd-86948c8b01b2. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:35:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-05dc846c-84c6-4831-9f6b-d4d6eda0d692 req-5570bfee-6250-4ca0-939e-73cc77a18149 service nova] Acquiring lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:35:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-05dc846c-84c6-4831-9f6b-d4d6eda0d692 req-5570bfee-6250-4ca0-939e-73cc77a18149 service nova] Acquired lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:35:59 user nova-compute[75017]: DEBUG nova.network.neutron [req-05dc846c-84c6-4831-9f6b-d4d6eda0d692 req-5570bfee-6250-4ca0-939e-73cc77a18149 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Refreshing network info cache for port ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'flavor' on Instance uuid f85c4f61-41d2-43d5-9984-19419aa31e3b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-05dc846c-84c6-4831-9f6b-d4d6eda0d692 req-5570bfee-6250-4ca0-939e-73cc77a18149 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updated VIF entry in instance network info cache for port ae934675-b72b-4659-90cd-86948c8b01b2. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG nova.network.neutron [req-05dc846c-84c6-4831-9f6b-d4d6eda0d692 req-5570bfee-6250-4ca0-939e-73cc77a18149 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updating instance_info_cache with network_info: [{"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-05dc846c-84c6-4831-9f6b-d4d6eda0d692 req-5570bfee-6250-4ca0-939e-73cc77a18149 service nova] Releasing lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:00 user nova-compute[75017]: INFO nova.compute.manager [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Attaching volume 93907b24-487d-44bf-bf4b-391d290d1af1 to /dev/vdb
Oct 30 09:36:00 user nova-compute[75017]: DEBUG os_brick.utils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf07977-98cf-4413-96b5-071e0dac90aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d347e8-94d2-45ff-8d2a-f997441ce8dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d64cad-f41e-4f07-ade7-b093ff525b63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b86fb-ba87-4f11-b02a-de8d39ef245a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:36:00 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:36:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22fc947-5756-45ef-bfb3-bd552f60a9a5]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG os_brick.utils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updating existing volume attachment record: 0c6e94e0-6928-4889-a48e-180baa572481 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:36:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkaKGTSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:36:20 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:36:20 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:36:20 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c222eae-3737-49b5-909c-689d61f2902b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:36:20 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31740e5-86b2-4a84-a8be-abff437ac703]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1] added
Oct 30 09:36:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f7dc93-f872-4589-8a1d-34c109bf5935]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: INFO nova.compute.manager [None req-2a844376-7cc7-4ce4-852e-ec8248745785 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Unrescuing
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a844376-7cc7-4ce4-852e-ec8248745785 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a844376-7cc7-4ce4-852e-ec8248745785 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquired lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2a844376-7cc7-4ce4-852e-ec8248745785 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d869598c-0d6d-4e86-9d35-82256941b2e1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkaKGTSE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkaKGTSE" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[323286b9-efa8-433e-a1d1-980945a97519]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dkaKGTSE'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c9c590-c4d2-4001-82ef-027530ebbd8a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[74036ab0-36f8-4c48-8de5-a267c5359494]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87282b2-2d38-45b1-b6bf-c11e25a5173b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1, portal: 172.16.0.220,3260]
Oct 30 09:36:20 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1, portal: 172.16.0.220,3260] successful.
Oct 30 09:36:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d2087-d54f-4dd9-af68-f119edf0fdf3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fdd77d-ea2f-4925-a50c-f208deee5ebd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 (non-flash)
Oct 30 09:36:20 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5089534d-6246-466a-9dc2-f1cc855c5061]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2a844376-7cc7-4ce4-852e-ec8248745785 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updating instance_info_cache with network_info: [{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a844376-7cc7-4ce4-852e-ec8248745785 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Releasing lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG nova.objects.instance [None req-2a844376-7cc7-4ce4-852e-ec8248745785 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'flavor' on Instance uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-1d8905e2-4de2-4e2e-b9e3-dd44a8121b0a req-497a886e-7420-4f7a-9ce1-cddb75e02b2f service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-unplugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1d8905e2-4de2-4e2e-b9e3-dd44a8121b0a req-497a886e-7420-4f7a-9ce1-cddb75e02b2f service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1d8905e2-4de2-4e2e-b9e3-dd44a8121b0a req-497a886e-7420-4f7a-9ce1-cddb75e02b2f service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1d8905e2-4de2-4e2e-b9e3-dd44a8121b0a req-497a886e-7420-4f7a-9ce1-cddb75e02b2f service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-1d8905e2-4de2-4e2e-b9e3-dd44a8121b0a req-497a886e-7420-4f7a-9ce1-cddb75e02b2f service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-unplugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:36:21 user nova-compute[75017]: WARNING nova.compute.manager [req-1d8905e2-4de2-4e2e-b9e3-dd44a8121b0a req-497a886e-7420-4f7a-9ce1-cddb75e02b2f service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-unplugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:36:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkaKGTSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23530643933396463', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530643933396463', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'flavor' on Instance uuid f85c4f61-41d2-43d5-9984-19419aa31e3b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:36:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:36:21 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:36:21 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:36:21 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:36:21 user nova-compute[75017]:   <serial>93907b24-487d-44bf-bf4b-391d290d1af1</serial>
Oct 30 09:36:21 user nova-compute[75017]: </disk>
Oct 30 09:36:21 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:36:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Instance destroyed successfully.
Oct 30 09:36:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:36:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:36:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] No VIF found with MAC fa:16:3e:f9:91:6c, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:36:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b11c3891-ce33-4944-b9a6-ea4f1062d993 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.007s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-89d3c16c-f129-44e7-8925-0ee64e8fddd5 req-27fd5498-330f-4e71-8ad1-e454f302c6ef service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-89d3c16c-f129-44e7-8925-0ee64e8fddd5 req-27fd5498-330f-4e71-8ad1-e454f302c6ef service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-89d3c16c-f129-44e7-8925-0ee64e8fddd5 req-27fd5498-330f-4e71-8ad1-e454f302c6ef service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-89d3c16c-f129-44e7-8925-0ee64e8fddd5 req-27fd5498-330f-4e71-8ad1-e454f302c6ef service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-89d3c16c-f129-44e7-8925-0ee64e8fddd5 req-27fd5498-330f-4e71-8ad1-e454f302c6ef service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:36:23 user nova-compute[75017]: WARNING nova.compute.manager [req-89d3c16c-f129-44e7-8925-0ee64e8fddd5 req-27fd5498-330f-4e71-8ad1-e454f302c6ef service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:36:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:24 user nova-compute[75017]: INFO nova.compute.manager [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Detaching volume 93907b24-487d-44bf-bf4b-391d290d1af1
Oct 30 09:36:24 user nova-compute[75017]: INFO nova.virt.block_device [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Attempting to driver detach volume 93907b24-487d-44bf-bf4b-391d290d1af1 from mountpoint /dev/vdb
Oct 30 09:36:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Attempting to detach device vdb from instance f85c4f61-41d2-43d5-9984-19419aa31e3b from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:36:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:36:24 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:36:24 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:36:24 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:36:24 user nova-compute[75017]:   <serial>93907b24-487d-44bf-bf4b-391d290d1af1</serial>
Oct 30 09:36:24 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:36:24 user nova-compute[75017]: </disk>
Oct 30 09:36:24 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:36:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Successfully detached device vdb from instance f85c4f61-41d2-43d5-9984-19419aa31e3b from the persistent domain config.
Oct 30 09:36:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f85c4f61-41d2-43d5-9984-19419aa31e3b from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:36:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:36:24 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:36:24 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:36:24 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:36:24 user nova-compute[75017]:   <serial>93907b24-487d-44bf-bf4b-391d290d1af1</serial>
Oct 30 09:36:24 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:36:24 user nova-compute[75017]: </disk>
Oct 30 09:36:24 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f85c4f61-41d2-43d5-9984-19419aa31e3b {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:36:25 user nova-compute[75017]: WARNING nova.compute.manager [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:36:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:36:25 user nova-compute[75017]: WARNING nova.compute.manager [req-0e3d92ba-1005-4260-aaa5-247a5e42757e req-b10bc95e-0299-4c33-a7bc-c5f2aab35678 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:36:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:25 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2a844376-7cc7-4ce4-852e-ec8248745785 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:36:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:28 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:32 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:32 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:36:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a9e714b-2802-4fea-848e-4ff271965a20 req-c678c3d4-2105-4177-b147-4584944a836b service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-changed-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-7a9e714b-2802-4fea-848e-4ff271965a20 req-c678c3d4-2105-4177-b147-4584944a836b service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Refreshing instance network info cache due to event network-changed-f6900dc8-c212-4060-8612-2b818a0912c5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a9e714b-2802-4fea-848e-4ff271965a20 req-c678c3d4-2105-4177-b147-4584944a836b service nova] Acquiring lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a9e714b-2802-4fea-848e-4ff271965a20 req-c678c3d4-2105-4177-b147-4584944a836b service nova] Acquired lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG nova.network.neutron [req-7a9e714b-2802-4fea-848e-4ff271965a20 req-c678c3d4-2105-4177-b147-4584944a836b service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Refreshing network info cache for port f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG nova.network.neutron [req-7a9e714b-2802-4fea-848e-4ff271965a20 req-c678c3d4-2105-4177-b147-4584944a836b service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updated VIF entry in instance network info cache for port f6900dc8-c212-4060-8612-2b818a0912c5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG nova.network.neutron [req-7a9e714b-2802-4fea-848e-4ff271965a20 req-c678c3d4-2105-4177-b147-4584944a836b service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updating instance_info_cache with network_info: [{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7a9e714b-2802-4fea-848e-4ff271965a20 req-c678c3d4-2105-4177-b147-4584944a836b service nova] Releasing lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:36:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:36:35 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:36:35 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8237MB free_disk=24.821094512939453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 85a15494-ab66-4692-949f-be1b0248971c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance f85c4f61-41d2-43d5-9984-19419aa31e3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d74e1f4c-b89b-4104-9611-0a2870f8d0ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:36:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:36:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:36:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:36:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:36:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating instance_info_cache with network_info: [{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:36:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:36:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:36:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:36:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:40 user nova-compute[75017]: INFO nova.compute.manager [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Shelving
Oct 30 09:36:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-92ade8dd-bd07-4216-a74e-a9fa18b133e4 req-de49e49c-8a40-4d69-ab7d-219803c10672 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-unplugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-92ade8dd-bd07-4216-a74e-a9fa18b133e4 req-de49e49c-8a40-4d69-ab7d-219803c10672 service nova] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-92ade8dd-bd07-4216-a74e-a9fa18b133e4 req-de49e49c-8a40-4d69-ab7d-219803c10672 service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-92ade8dd-bd07-4216-a74e-a9fa18b133e4 req-de49e49c-8a40-4d69-ab7d-219803c10672 service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-92ade8dd-bd07-4216-a74e-a9fa18b133e4 req-de49e49c-8a40-4d69-ab7d-219803c10672 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] No waiting events found dispatching network-vif-unplugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:36:40 user nova-compute[75017]: WARNING nova.compute.manager [req-92ade8dd-bd07-4216-a74e-a9fa18b133e4 req-de49e49c-8a40-4d69-ab7d-219803c10672 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received unexpected event network-vif-unplugged-f6900dc8-c212-4060-8612-2b818a0912c5 for instance with vm_state active and task_state shelving.
Oct 30 09:36:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance destroyed successfully.
Oct 30 09:36:41 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Beginning cold snapshot process
Oct 30 09:36:41 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:36:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk /opt/stack/data/nova/instances/snapshots/tmpjo31f4pg/83e62dbb29534666a4ba408f08724aef {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk /opt/stack/data/nova/instances/snapshots/tmpjo31f4pg/83e62dbb29534666a4ba408f08724aef" returned: 0 in 0.538s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:41 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Snapshot extracted, beginning image upload
Oct 30 09:36:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-584ddde4-0bc8-4bdc-99e2-7c5d796cf004 req-441823b8-0802-41b5-8022-01ba8d91d6ab service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-584ddde4-0bc8-4bdc-99e2-7c5d796cf004 req-441823b8-0802-41b5-8022-01ba8d91d6ab service nova] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-584ddde4-0bc8-4bdc-99e2-7c5d796cf004 req-441823b8-0802-41b5-8022-01ba8d91d6ab service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-584ddde4-0bc8-4bdc-99e2-7c5d796cf004 req-441823b8-0802-41b5-8022-01ba8d91d6ab service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-584ddde4-0bc8-4bdc-99e2-7c5d796cf004 req-441823b8-0802-41b5-8022-01ba8d91d6ab service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] No waiting events found dispatching network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:36:42 user nova-compute[75017]: WARNING nova.compute.manager [req-584ddde4-0bc8-4bdc-99e2-7c5d796cf004 req-441823b8-0802-41b5-8022-01ba8d91d6ab service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received unexpected event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 for instance with vm_state active and task_state shelving_image_uploading.
Oct 30 09:36:44 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Snapshot image upload complete
Oct 30 09:36:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:36:44 user nova-compute[75017]: INFO nova.compute.manager [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Shelve offloading
Oct 30 09:36:44 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance destroyed successfully.
Oct 30 09:36:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:36:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:36:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquired lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:36:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:36:45 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f85c4f61-41d2-43d5-9984-19419aa31e3b is timed out.
Oct 30 09:36:45 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Successfully detached device vdb from instance f85c4f61-41d2-43d5-9984-19419aa31e3b from the live domain config.
Oct 30 09:36:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkaKGTSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:36:45 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51c1b36-bf35-4a5b-8e16-d02ad684f8df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:36:45 user nova-compute[75017]: No targets found.
Oct 30 09:36:45 user nova-compute[75017]: iSNS:
Oct 30 09:36:45 user nova-compute[75017]: No targets found.
Oct 30 09:36:45 user nova-compute[75017]: STATIC:
Oct 30 09:36:45 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:36:45 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:36:45 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:36:45 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62
Oct 30 09:36:45 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:36:45 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:36:45 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1
Oct 30 09:36:45 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:36:45 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:36:45 user nova-compute[75017]: FIRMWARE:
Oct 30 09:36:45 user nova-compute[75017]: No targets found.
Oct 30 09:36:45 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:36:45 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:36:45 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c870f3a5-14d6-4ece-8cb0-eb7a357dbd55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updating instance_info_cache with network_info: [{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7a2f91-1591-4bc3-820e-4da03ee7f032]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:36:45 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:36:45 user nova-compute[75017]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 (non-flash)
Oct 30 09:36:45 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:36:45 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:36:45 user nova-compute[75017]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 (non-flash)
Oct 30 09:36:45 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccc715a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Releasing lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a84de06-c8e0-486b-97cf-0fd3a59f2d00]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d233b5c2-715e-43ac-94a9-cbec0a52f6c4]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8bbfab-3ffe-4087-a0b8-04483a807940]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d251a2-9ee0-4000-996b-3a4b60fc2721]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6319f0a6-facf-423e-8fa1-07b707d7fecc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17ac7c6-eb31-4c76-9c17-eedac79fc4a3]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1, portal: 172.16.0.220,3260]
Oct 30 09:36:45 user nova-compute[75017]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1, portal: 172.16.0.220,3260] successful.
Oct 30 09:36:45 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93907b24-487d-44bf-bf4b-391d290d1af1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[930301e1-f12a-4e73-9ec8-48b0cfb1d2b9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] <== disconnect_volume: return (460ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:36:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'flavor' on Instance uuid f85c4f61-41d2-43d5-9984-19419aa31e3b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:36:46 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance destroyed successfully.
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'resources' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1543175365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1543175365',id=41,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbhc/J2RhKcyGsZnv/Wb9vaAsjwFTR/gt63CZjK7jMYs0Mt3yrGE6pklvE8SdT3UJkNVsJU54rZHi2TbCExh8j+wG3OWvK8+6DAtlHMbL2ONsSjBVxMfGxh9RICXdcoBg==',key_name='tempest-keypair-1093075271',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-6ol7na3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member',shelved_at='2023-10-30T09:36:44.608116',shelved_host='user',shelved_image_id='76b0cff6-b008-497c-83c0-852a3870cadb'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=d74e1f4c-b89b-4104-9611-0a2870f8d0ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG os_vif [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6900dc8-c2, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-db112487-6db6-4391-9168-15d11e0cfbbb tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.159s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-c040625e-f15c-4e95-a427-00dcb1cf75c7 req-13537e00-0e81-4874-aeb8-aa9ba1d09ac4 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-changed-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-c040625e-f15c-4e95-a427-00dcb1cf75c7 req-13537e00-0e81-4874-aeb8-aa9ba1d09ac4 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Refreshing instance network info cache due to event network-changed-f6900dc8-c212-4060-8612-2b818a0912c5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c040625e-f15c-4e95-a427-00dcb1cf75c7 req-13537e00-0e81-4874-aeb8-aa9ba1d09ac4 service nova] Acquiring lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c040625e-f15c-4e95-a427-00dcb1cf75c7 req-13537e00-0e81-4874-aeb8-aa9ba1d09ac4 service nova] Acquired lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.network.neutron [req-c040625e-f15c-4e95-a427-00dcb1cf75c7 req-13537e00-0e81-4874-aeb8-aa9ba1d09ac4 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Refreshing network info cache for port f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=719438c4-6c0d-4afb-b036-b8ed92fea222) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:46 user nova-compute[75017]: INFO os_vif [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2')
Oct 30 09:36:46 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Deleting instance files /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec_del
Oct 30 09:36:46 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Deletion of /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec_del complete
Oct 30 09:36:46 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Deleted allocations for instance d74e1f4c-b89b-4104-9611-0a2870f8d0ec
Oct 30 09:36:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'numa_topology' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.objects.base [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<d74e1f4c-b89b-4104-9611-0a2870f8d0ec> lazy-loaded attributes: resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:36:46 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:36:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:47 user nova-compute[75017]: DEBUG nova.network.neutron [req-c040625e-f15c-4e95-a427-00dcb1cf75c7 req-13537e00-0e81-4874-aeb8-aa9ba1d09ac4 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updated VIF entry in instance network info cache for port f6900dc8-c212-4060-8612-2b818a0912c5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:36:47 user nova-compute[75017]: DEBUG nova.network.neutron [req-c040625e-f15c-4e95-a427-00dcb1cf75c7 req-13537e00-0e81-4874-aeb8-aa9ba1d09ac4 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updating instance_info_cache with network_info: [{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:36:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c040625e-f15c-4e95-a427-00dcb1cf75c7 req-13537e00-0e81-4874-aeb8-aa9ba1d09ac4 service nova] Releasing lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:36:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0dde5f6f-cb3f-40c4-9d69-164e8e1aecd9 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.033s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:36:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:55 user nova-compute[75017]: DEBUG nova.compute.manager [req-08b309a6-fff4-41a7-87a5-1fae7d9b071a req-726916a2-a79f-422b-a612-6f8faa641922 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:55 user nova-compute[75017]: DEBUG nova.compute.manager [req-08b309a6-fff4-41a7-87a5-1fae7d9b071a req-726916a2-a79f-422b-a612-6f8faa641922 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing instance network info cache due to event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:36:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-08b309a6-fff4-41a7-87a5-1fae7d9b071a req-726916a2-a79f-422b-a612-6f8faa641922 service nova] Acquiring lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:36:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-08b309a6-fff4-41a7-87a5-1fae7d9b071a req-726916a2-a79f-422b-a612-6f8faa641922 service nova] Acquired lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:36:55 user nova-compute[75017]: DEBUG nova.network.neutron [req-08b309a6-fff4-41a7-87a5-1fae7d9b071a req-726916a2-a79f-422b-a612-6f8faa641922 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-08b309a6-fff4-41a7-87a5-1fae7d9b071a req-726916a2-a79f-422b-a612-6f8faa641922 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updated VIF entry in instance network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-08b309a6-fff4-41a7-87a5-1fae7d9b071a req-726916a2-a79f-422b-a612-6f8faa641922 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating instance_info_cache with network_info: [{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-08b309a6-fff4-41a7-87a5-1fae7d9b071a req-726916a2-a79f-422b-a612-6f8faa641922 service nova] Releasing lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-fbe888f9-fbba-4dfe-8504-183e9b481e40 req-3177adc6-3c30-45bf-8c71-6f6f141cec69 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-fbe888f9-fbba-4dfe-8504-183e9b481e40 req-3177adc6-3c30-45bf-8c71-6f6f141cec69 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing instance network info cache due to event network-changed-e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fbe888f9-fbba-4dfe-8504-183e9b481e40 req-3177adc6-3c30-45bf-8c71-6f6f141cec69 service nova] Acquiring lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fbe888f9-fbba-4dfe-8504-183e9b481e40 req-3177adc6-3c30-45bf-8c71-6f6f141cec69 service nova] Acquired lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG nova.network.neutron [req-fbe888f9-fbba-4dfe-8504-183e9b481e40 req-3177adc6-3c30-45bf-8c71-6f6f141cec69 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Refreshing network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:36:56 user nova-compute[75017]: INFO nova.compute.manager [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Detaching volume 18555288-52aa-4fe7-8b00-d0808706fd62
Oct 30 09:36:56 user nova-compute[75017]: INFO nova.virt.block_device [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Attempting to driver detach volume 18555288-52aa-4fe7-8b00-d0808706fd62 from mountpoint /dev/vdb
Oct 30 09:36:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Attempting to detach device vdb from instance 85a15494-ab66-4692-949f-be1b0248971c from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:36:56 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:36:56 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:36:56 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:36:56 user nova-compute[75017]:   <serial>18555288-52aa-4fe7-8b00-d0808706fd62</serial>
Oct 30 09:36:56 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:36:56 user nova-compute[75017]: </disk>
Oct 30 09:36:56 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:36:56 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully detached device vdb from instance 85a15494-ab66-4692-949f-be1b0248971c from the persistent domain config.
Oct 30 09:36:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85a15494-ab66-4692-949f-be1b0248971c from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:36:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:36:56 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:36:56 user nova-compute[75017]:   <source dev="/dev/sdb"/>
Oct 30 09:36:56 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:36:56 user nova-compute[75017]:   <serial>18555288-52aa-4fe7-8b00-d0808706fd62</serial>
Oct 30 09:36:56 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:36:56 user nova-compute[75017]: </disk>
Oct 30 09:36:56 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:36:57 user nova-compute[75017]: DEBUG nova.network.neutron [req-fbe888f9-fbba-4dfe-8504-183e9b481e40 req-3177adc6-3c30-45bf-8c71-6f6f141cec69 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updated VIF entry in instance network info cache for port e060ba01-5902-47ef-b07a-900fd6891d5c. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:36:57 user nova-compute[75017]: DEBUG nova.network.neutron [req-fbe888f9-fbba-4dfe-8504-183e9b481e40 req-3177adc6-3c30-45bf-8c71-6f6f141cec69 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating instance_info_cache with network_info: [{"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:36:57 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-fbe888f9-fbba-4dfe-8504-183e9b481e40 req-3177adc6-3c30-45bf-8c71-6f6f141cec69 service nova] Releasing lock "refresh_cache-85a15494-ab66-4692-949f-be1b0248971c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:36:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85a15494-ab66-4692-949f-be1b0248971c {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:37:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:37:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:37:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:37:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:37:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:37:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:37:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:37:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:37:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:37:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-98e655fe-851c-412f-93d3-63c2dbd11521 req-8e2a4eae-4eab-45bc-97b1-33b3637a1953 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received event network-changed-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-98e655fe-851c-412f-93d3-63c2dbd11521 req-8e2a4eae-4eab-45bc-97b1-33b3637a1953 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Refreshing instance network info cache due to event network-changed-ae934675-b72b-4659-90cd-86948c8b01b2. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-98e655fe-851c-412f-93d3-63c2dbd11521 req-8e2a4eae-4eab-45bc-97b1-33b3637a1953 service nova] Acquiring lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-98e655fe-851c-412f-93d3-63c2dbd11521 req-8e2a4eae-4eab-45bc-97b1-33b3637a1953 service nova] Acquired lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-98e655fe-851c-412f-93d3-63c2dbd11521 req-8e2a4eae-4eab-45bc-97b1-33b3637a1953 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Refreshing network info cache for port ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:15 user nova-compute[75017]: INFO nova.compute.manager [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Terminating instance
Oct 30 09:37:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-f577d553-962c-42ff-9af3-5689ebf63b24 req-b6d0654d-05dd-4ee8-9b01-c33e34ea447d service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received event network-vif-unplugged-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f577d553-962c-42ff-9af3-5689ebf63b24 req-b6d0654d-05dd-4ee8-9b01-c33e34ea447d service nova] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f577d553-962c-42ff-9af3-5689ebf63b24 req-b6d0654d-05dd-4ee8-9b01-c33e34ea447d service nova] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f577d553-962c-42ff-9af3-5689ebf63b24 req-b6d0654d-05dd-4ee8-9b01-c33e34ea447d service nova] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-f577d553-962c-42ff-9af3-5689ebf63b24 req-b6d0654d-05dd-4ee8-9b01-c33e34ea447d service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] No waiting events found dispatching network-vif-unplugged-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG nova.compute.manager [req-f577d553-962c-42ff-9af3-5689ebf63b24 req-b6d0654d-05dd-4ee8-9b01-c33e34ea447d service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received event network-vif-unplugged-ae934675-b72b-4659-90cd-86948c8b01b2 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-98e655fe-851c-412f-93d3-63c2dbd11521 req-8e2a4eae-4eab-45bc-97b1-33b3637a1953 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updated VIF entry in instance network info cache for port ae934675-b72b-4659-90cd-86948c8b01b2. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-98e655fe-851c-412f-93d3-63c2dbd11521 req-8e2a4eae-4eab-45bc-97b1-33b3637a1953 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updating instance_info_cache with network_info: [{"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:37:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-98e655fe-851c-412f-93d3-63c2dbd11521 req-8e2a4eae-4eab-45bc-97b1-33b3637a1953 service nova] Releasing lock "refresh_cache-f85c4f61-41d2-43d5-9984-19419aa31e3b" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:37:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Instance destroyed successfully.
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.objects.instance [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'resources' on Instance uuid f85c4f61-41d2-43d5-9984-19419aa31e3b {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-180673827',display_name='tempest-TestStampPattern-server-180673827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-180673827',id=40,image_ref='ff999978-e686-436e-bb9d-f3437e5bc3ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn4YBrWT+oXcMf0FPfsei5t/kRlFe3zwa88mbl5XB02JUbxKsTrVMHZBihz5S+PsRa4KWSStTjiCQfgLkYHyr/M3IBxUs5GEFYj004rG0vhFW1t4jvvI3x4alcHZMrm+A==',key_name='tempest-TestStampPattern-619789116',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:34:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10cb9c81a01a44079a469bb6aea845cc',ramdisk_id='',reservation_id='r-q763n0ma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bfbdfdec-fa8f-4c30-999b-8975cbfc37ef',image_min_disk='1',image_min_ram='0',image_owner_id='10cb9c81a01a44079a469bb6aea845cc',image_owner_project_name='tempest-TestStampPattern-1711313576',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1711313576-project-member',image_user_id='4829e2b76b044474a226ba8a6a48a393',owner_project_name='tempest-TestStampPattern-1711313576',owner_user_name='tempest-TestStampPattern-1711313576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:34:15Z,user_data=None,user_id='4829e2b76b044474a226ba8a6a48a393',uuid=f85c4f61-41d2-43d5-9984-19419aa31e3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converting VIF {"id": "ae934675-b72b-4659-90cd-86948c8b01b2", "address": "fa:16:3e:f9:91:6c", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae934675-b7", "ovs_interfaceid": "ae934675-b72b-4659-90cd-86948c8b01b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:91:6c,bridge_name='br-int',has_traffic_filtering=True,id=ae934675-b72b-4659-90cd-86948c8b01b2,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae934675-b7') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG os_vif [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:91:6c,bridge_name='br-int',has_traffic_filtering=True,id=ae934675-b72b-4659-90cd-86948c8b01b2,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae934675-b7') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae934675-b7, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84d985ce-1513-4022-9a40-e1e43d43baf5) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:16 user nova-compute[75017]: INFO os_vif [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:91:6c,bridge_name='br-int',has_traffic_filtering=True,id=ae934675-b72b-4659-90cd-86948c8b01b2,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae934675-b7')
Oct 30 09:37:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Deleting instance files /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b_del
Oct 30 09:37:16 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Deletion of /opt/stack/data/nova/instances/f85c4f61-41d2-43d5-9984-19419aa31e3b_del complete
Oct 30 09:37:16 user nova-compute[75017]: INFO nova.compute.manager [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 30 09:37:16 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-73e0abdb-d7eb-4db8-9e1c-0ebe67e30094 req-27ab8385-af44-4c6c-9682-9cbad1452b40 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received event network-vif-deleted-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:37:16 user nova-compute[75017]: INFO nova.compute.manager [req-73e0abdb-d7eb-4db8-9e1c-0ebe67e30094 req-27ab8385-af44-4c6c-9682-9cbad1452b40 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Neutron deleted interface ae934675-b72b-4659-90cd-86948c8b01b2; detaching it from the instance and deleting it from the info cache
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.network.neutron [req-73e0abdb-d7eb-4db8-9e1c-0ebe67e30094 req-27ab8385-af44-4c6c-9682-9cbad1452b40 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:37:16 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Took 0.65 seconds to deallocate network for instance.
Oct 30 09:37:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-73e0abdb-d7eb-4db8-9e1c-0ebe67e30094 req-27ab8385-af44-4c6c-9682-9cbad1452b40 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Detach interface failed, port_id=ae934675-b72b-4659-90cd-86948c8b01b2, reason: Instance f85c4f61-41d2-43d5-9984-19419aa31e3b could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:17 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Deleted allocations for instance f85c4f61-41d2-43d5-9984-19419aa31e3b
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-671f32f2-2549-4cab-93e3-fb0978c4644e tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.920s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 85a15494-ab66-4692-949f-be1b0248971c is timed out.
Oct 30 09:37:17 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully detached device vdb from instance 85a15494-ab66-4692-949f-be1b0248971c from the live domain config.
Oct 30 09:37:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNKmWtHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:37:17 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1462ba-bed9-489f-8b37-471bfc38cdb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:37:17 user nova-compute[75017]: No targets found.
Oct 30 09:37:17 user nova-compute[75017]: iSNS:
Oct 30 09:37:17 user nova-compute[75017]: No targets found.
Oct 30 09:37:17 user nova-compute[75017]: STATIC:
Oct 30 09:37:17 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:37:17 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:37:17 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:37:17 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62
Oct 30 09:37:17 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:37:17 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:37:17 user nova-compute[75017]: FIRMWARE:
Oct 30 09:37:17 user nova-compute[75017]: No targets found.
Oct 30 09:37:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:37:17 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:37:17 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb10e0cb-62c5-48a6-9de1-5c7ba626d1b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[faea8e89-172c-4e55-845f-84d96786251a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:37:17 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:37:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:37:17 user nova-compute[75017]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 (non-flash)
Oct 30 09:37:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d1012caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea970efa-de8a-4cd4-b210-022b565f4c88]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a2ab9d-d7aa-4902-95a2-48b2fa4b9dc4]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2676bae4-c6e9-449e-b720-231c5696cfa4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1103c770-0260-4fc0-b00b-1e4d407918ce]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4ba8f6-116f-49f3-bd56-9100ba1ca6b4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01e1486-ce42-465e-bc59-a0d69514897e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62, portal: 172.16.0.220,3260]
Oct 30 09:37:17 user nova-compute[75017]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62, portal: 172.16.0.220,3260] successful.
Oct 30 09:37:17 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18555288-52aa-4fe7-8b00-d0808706fd62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1053ac43-ed21-4b45-bb34-4abf389947c3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] <== disconnect_volume: return (287ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-d9434557-82f9-42d4-b9ad-f12cb4a7eac9 req-cac35306-c3ba-4774-b98d-dc8966480cb4 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received event network-vif-plugged-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d9434557-82f9-42d4-b9ad-f12cb4a7eac9 req-cac35306-c3ba-4774-b98d-dc8966480cb4 service nova] Acquiring lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d9434557-82f9-42d4-b9ad-f12cb4a7eac9 req-cac35306-c3ba-4774-b98d-dc8966480cb4 service nova] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d9434557-82f9-42d4-b9ad-f12cb4a7eac9 req-cac35306-c3ba-4774-b98d-dc8966480cb4 service nova] Lock "f85c4f61-41d2-43d5-9984-19419aa31e3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-d9434557-82f9-42d4-b9ad-f12cb4a7eac9 req-cac35306-c3ba-4774-b98d-dc8966480cb4 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] No waiting events found dispatching network-vif-plugged-ae934675-b72b-4659-90cd-86948c8b01b2 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:37:17 user nova-compute[75017]: WARNING nova.compute.manager [req-d9434557-82f9-42d4-b9ad-f12cb4a7eac9 req-cac35306-c3ba-4774-b98d-dc8966480cb4 service nova] [instance: f85c4f61-41d2-43d5-9984-19419aa31e3b] Received unexpected event network-vif-plugged-ae934675-b72b-4659-90cd-86948c8b01b2 for instance with vm_state deleted and task_state None.
Oct 30 09:37:18 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'flavor' on Instance uuid 85a15494-ab66-4692-949f-be1b0248971c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:37:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1214c569-1d4c-4f95-9fc7-6f03a57cae87 tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:37:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:37:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:37:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:37:28 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:37:28 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:37:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:37:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:37:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:37:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:37:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:37:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:37:35 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:37:35 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8533MB free_disk=24.798885345458984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 85a15494-ab66-4692-949f-be1b0248971c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:37:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:37:37 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:37:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:37:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:37:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:37:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updating instance_info_cache with network_info: [{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:37:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:37:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:37:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:37:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:37:41 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:37:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:58 user nova-compute[75017]: INFO nova.compute.manager [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Terminating instance
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-509c27e7-558d-495e-84b0-4dc9a7718ac9 req-66051233-d5b0-43e8-9962-31a97492e7f2 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-unplugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-509c27e7-558d-495e-84b0-4dc9a7718ac9 req-66051233-d5b0-43e8-9962-31a97492e7f2 service nova] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-509c27e7-558d-495e-84b0-4dc9a7718ac9 req-66051233-d5b0-43e8-9962-31a97492e7f2 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-509c27e7-558d-495e-84b0-4dc9a7718ac9 req-66051233-d5b0-43e8-9962-31a97492e7f2 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-509c27e7-558d-495e-84b0-4dc9a7718ac9 req-66051233-d5b0-43e8-9962-31a97492e7f2 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] No waiting events found dispatching network-vif-unplugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-509c27e7-558d-495e-84b0-4dc9a7718ac9 req-66051233-d5b0-43e8-9962-31a97492e7f2 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-unplugged-e060ba01-5902-47ef-b07a-900fd6891d5c for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:37:58 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Instance destroyed successfully.
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.objects.instance [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lazy-loading 'resources' on Instance uuid 85a15494-ab66-4692-949f-be1b0248971c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-731552492',display_name='tempest-TestMinimumBasicScenario-server-731552492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-731552492',id=38,image_ref='29e6f143-eb31-486f-9a12-ca9be6ff8adc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN8HM2ppUbiiRNlRtAjnDhOOCi0tEJPMVseOsi6EF3jYCNB+VYo1NN1WFEEbLUjkvhgfd9/jM7gf4Pj6dEvQ6jYnoHhYAHQaeSCGYMz4P4Y25ff+pqH9eGNH2wNR/zXLw==',key_name='tempest-TestMinimumBasicScenario-1041607142',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c084ddae4af6448ca2f5b36497ab3a2b',ramdisk_id='',reservation_id='r-06io560d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='29e6f143-eb31-486f-9a12-ca9be6ff8adc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-692819593',owner_user_name='tempest-TestMinimumBasicScenario-692819593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:35:12Z,user_data=None,user_id='2ab92f42f38f4dbf8826cae09de164dd',uuid=85a15494-ab66-4692-949f-be1b0248971c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converting VIF {"id": "e060ba01-5902-47ef-b07a-900fd6891d5c", "address": "fa:16:3e:7c:14:28", "network": {"id": "f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-436884814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c084ddae4af6448ca2f5b36497ab3a2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060ba01-59", "ovs_interfaceid": "e060ba01-5902-47ef-b07a-900fd6891d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:14:28,bridge_name='br-int',has_traffic_filtering=True,id=e060ba01-5902-47ef-b07a-900fd6891d5c,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060ba01-59') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG os_vif [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:14:28,bridge_name='br-int',has_traffic_filtering=True,id=e060ba01-5902-47ef-b07a-900fd6891d5c,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060ba01-59') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape060ba01-59, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c334ea9-9df6-41a7-8bb4-c9a032af04d0) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:37:58 user nova-compute[75017]: INFO os_vif [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:14:28,bridge_name='br-int',has_traffic_filtering=True,id=e060ba01-5902-47ef-b07a-900fd6891d5c,network=Network(f0d0bcf6-026c-4132-a5c0-8dc6c303f4d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060ba01-59')
Oct 30 09:37:58 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Deleting instance files /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c_del
Oct 30 09:37:58 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Deletion of /opt/stack/data/nova/instances/85a15494-ab66-4692-949f-be1b0248971c_del complete
Oct 30 09:37:58 user nova-compute[75017]: INFO nova.compute.manager [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 30 09:37:58 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:37:58 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 85a15494-ab66-4692-949f-be1b0248971c] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:37:59 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:37:59 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Took 0.44 seconds to deallocate network for instance.
Oct 30 09:37:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:37:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:37:59 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:37:59 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:37:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:37:59 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Deleted allocations for instance 85a15494-ab66-4692-949f-be1b0248971c
Oct 30 09:37:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9139c39f-187a-4d6b-ac2f-0b3c543bf37d tempest-TestMinimumBasicScenario-692819593 tempest-TestMinimumBasicScenario-692819593-project-member] Lock "85a15494-ab66-4692-949f-be1b0248971c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.737s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-006f0941-1b9d-48cc-8a36-f5eab7a76596 req-ab640d6b-e87a-46bc-91e8-01f633ba7063 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-006f0941-1b9d-48cc-8a36-f5eab7a76596 req-ab640d6b-e87a-46bc-91e8-01f633ba7063 service nova] Acquiring lock "85a15494-ab66-4692-949f-be1b0248971c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-006f0941-1b9d-48cc-8a36-f5eab7a76596 req-ab640d6b-e87a-46bc-91e8-01f633ba7063 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-006f0941-1b9d-48cc-8a36-f5eab7a76596 req-ab640d6b-e87a-46bc-91e8-01f633ba7063 service nova] Lock "85a15494-ab66-4692-949f-be1b0248971c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-006f0941-1b9d-48cc-8a36-f5eab7a76596 req-ab640d6b-e87a-46bc-91e8-01f633ba7063 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] No waiting events found dispatching network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:38:00 user nova-compute[75017]: WARNING nova.compute.manager [req-006f0941-1b9d-48cc-8a36-f5eab7a76596 req-ab640d6b-e87a-46bc-91e8-01f633ba7063 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received unexpected event network-vif-plugged-e060ba01-5902-47ef-b07a-900fd6891d5c for instance with vm_state deleted and task_state None.
Oct 30 09:38:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-006f0941-1b9d-48cc-8a36-f5eab7a76596 req-ab640d6b-e87a-46bc-91e8-01f633ba7063 service nova] [instance: 85a15494-ab66-4692-949f-be1b0248971c] Received event network-vif-deleted-e060ba01-5902-47ef-b07a-900fd6891d5c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:38:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:38:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:38:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:38:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "eab947f6-fbac-4685-adc7-722206413b8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "eab947f6-fbac-4685-adc7-722206413b8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:38:12 user nova-compute[75017]: INFO nova.compute.claims [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Claim successful on node user
Oct 30 09:38:12 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:38:12 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:38:12 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:38:12 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG nova.policy [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd734d26551bc41a585d443a24fac0cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ba6409f82447ba9d0f4f56eef88b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:38:13 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Creating image(s)
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "/opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "/opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "/opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk 1073741824" returned: 0 in 0.050s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.230s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Successfully created port: 5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Cannot resize image /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Ensure instance console log exists: /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Successfully updated port: 5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquired lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-01145194-db9c-4d09-b09f-0ecb3b5bb508 req-ef4b3b64-f8fc-46a0-b445-8d1349796c52 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received event network-changed-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-01145194-db9c-4d09-b09f-0ecb3b5bb508 req-ef4b3b64-f8fc-46a0-b445-8d1349796c52 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Refreshing instance network info cache due to event network-changed-5a158522-5fa3-4331-9ded-b6a4aead610b. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-01145194-db9c-4d09-b09f-0ecb3b5bb508 req-ef4b3b64-f8fc-46a0-b445-8d1349796c52 service nova] Acquiring lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG nova.network.neutron [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Updating instance_info_cache with network_info: [{"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Releasing lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Instance network_info: |[{"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-01145194-db9c-4d09-b09f-0ecb3b5bb508 req-ef4b3b64-f8fc-46a0-b445-8d1349796c52 service nova] Acquired lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG nova.network.neutron [req-01145194-db9c-4d09-b09f-0ecb3b5bb508 req-ef4b3b64-f8fc-46a0-b445-8d1349796c52 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Refreshing network info cache for port 5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:38:14 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Start _get_guest_xml network_info=[{"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:38:15 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:38:15 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124615992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124615992',id=42,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-ygchr2d7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:38:13Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=eab947f6-fbac-4685-adc7-722206413b8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=5a158522-5fa3-4331-9ded-b6a4aead610b,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a158522-5f') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.objects.instance [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'pci_devices' on Instance uuid eab947f6-fbac-4685-adc7-722206413b8a {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:38:15 user nova-compute[75017]:   <uuid>eab947f6-fbac-4685-adc7-722206413b8a</uuid>
Oct 30 09:38:15 user nova-compute[75017]:   <name>instance-0000002a</name>
Oct 30 09:38:15 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:38:15 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:38:15 user nova-compute[75017]:   <metadata>
Oct 30 09:38:15 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:38:15 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:38:15 user nova-compute[75017]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2124615992</nova:name>
Oct 30 09:38:15 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:38:15</nova:creationTime>
Oct 30 09:38:15 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:38:15 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:38:15 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:38:15 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:38:15 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:38:15 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:38:15 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:38:15 user nova-compute[75017]:       <nova:owner>
Oct 30 09:38:15 user nova-compute[75017]:         <nova:user uuid="d734d26551bc41a585d443a24fac0cd8">tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member</nova:user>
Oct 30 09:38:15 user nova-compute[75017]:         <nova:project uuid="76ba6409f82447ba9d0f4f56eef88b1d">tempest-ServerBootFromVolumeStableRescueTest-1506388181</nova:project>
Oct 30 09:38:15 user nova-compute[75017]:       </nova:owner>
Oct 30 09:38:15 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:38:15 user nova-compute[75017]:       <nova:ports>
Oct 30 09:38:15 user nova-compute[75017]:         <nova:port uuid="5a158522-5fa3-4331-9ded-b6a4aead610b">
Oct 30 09:38:15 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 09:38:15 user nova-compute[75017]:         </nova:port>
Oct 30 09:38:15 user nova-compute[75017]:       </nova:ports>
Oct 30 09:38:15 user nova-compute[75017]:     </nova:instance>
Oct 30 09:38:15 user nova-compute[75017]:   </metadata>
Oct 30 09:38:15 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:38:15 user nova-compute[75017]:     <system>
Oct 30 09:38:15 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:38:15 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:38:15 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:38:15 user nova-compute[75017]:       <entry name="serial">eab947f6-fbac-4685-adc7-722206413b8a</entry>
Oct 30 09:38:15 user nova-compute[75017]:       <entry name="uuid">eab947f6-fbac-4685-adc7-722206413b8a</entry>
Oct 30 09:38:15 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:38:15 user nova-compute[75017]:     </system>
Oct 30 09:38:15 user nova-compute[75017]:   </sysinfo>
Oct 30 09:38:15 user nova-compute[75017]:   <os>
Oct 30 09:38:15 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:38:15 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:38:15 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:38:15 user nova-compute[75017]:   </os>
Oct 30 09:38:15 user nova-compute[75017]:   <features>
Oct 30 09:38:15 user nova-compute[75017]:     <acpi/>
Oct 30 09:38:15 user nova-compute[75017]:     <apic/>
Oct 30 09:38:15 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:38:15 user nova-compute[75017]:   </features>
Oct 30 09:38:15 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:38:15 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:38:15 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:38:15 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:38:15 user nova-compute[75017]:   </clock>
Oct 30 09:38:15 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:38:15 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:38:15 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:38:15 user nova-compute[75017]:   </cpu>
Oct 30 09:38:15 user nova-compute[75017]:   <devices>
Oct 30 09:38:15 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:38:15 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:38:15 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk"/>
Oct 30 09:38:15 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:38:15 user nova-compute[75017]:     </disk>
Oct 30 09:38:15 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:38:15 user nova-compute[75017]:       <mac address="fa:16:3e:09:8c:7c"/>
Oct 30 09:38:15 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:38:15 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:38:15 user nova-compute[75017]:       <target dev="tap5a158522-5f"/>
Oct 30 09:38:15 user nova-compute[75017]:     </interface>
Oct 30 09:38:15 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:38:15 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/console.log" append="off"/>
Oct 30 09:38:15 user nova-compute[75017]:     </serial>
Oct 30 09:38:15 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:38:15 user nova-compute[75017]:     <video>
Oct 30 09:38:15 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:38:15 user nova-compute[75017]:     </video>
Oct 30 09:38:15 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:38:15 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:38:15 user nova-compute[75017]:     </rng>
Oct 30 09:38:15 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:38:15 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:38:15 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:38:15 user nova-compute[75017]:     </memballoon>
Oct 30 09:38:15 user nova-compute[75017]:   </devices>
Oct 30 09:38:15 user nova-compute[75017]: </domain>
Oct 30 09:38:15 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124615992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124615992',id=42,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-ygchr2d7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:38:13Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=eab947f6-fbac-4685-adc7-722206413b8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=5a158522-5fa3-4331-9ded-b6a4aead610b,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a158522-5f') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG os_vif [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=5a158522-5fa3-4331-9ded-b6a4aead610b,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a158522-5f') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40953362-8f24-59cc-a8e0-6cb1a9036e01', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a158522-5f, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a158522-5f, col_values=(('qos', UUID('c9124078-6e96-43be-a25a-645c380ff8c1')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a158522-5f, col_values=(('external_ids', {'iface-id': '5a158522-5fa3-4331-9ded-b6a4aead610b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:8c:7c', 'vm-uuid': 'eab947f6-fbac-4685-adc7-722206413b8a'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:15 user nova-compute[75017]: INFO os_vif [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=5a158522-5fa3-4331-9ded-b6a4aead610b,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a158522-5f')
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No VIF found with MAC fa:16:3e:09:8c:7c, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-01145194-db9c-4d09-b09f-0ecb3b5bb508 req-ef4b3b64-f8fc-46a0-b445-8d1349796c52 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Updated VIF entry in instance network info cache for port 5a158522-5fa3-4331-9ded-b6a4aead610b. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG nova.network.neutron [req-01145194-db9c-4d09-b09f-0ecb3b5bb508 req-ef4b3b64-f8fc-46a0-b445-8d1349796c52 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Updating instance_info_cache with network_info: [{"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:38:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-01145194-db9c-4d09-b09f-0ecb3b5bb508 req-ef4b3b64-f8fc-46a0-b445-8d1349796c52 service nova] Releasing lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:38:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-ddc64253-a23f-4234-aaad-a7f43b8d0b2f req-2fbd7f7d-e1d8-4d08-aa87-3251db4aac78 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received event network-vif-plugged-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ddc64253-a23f-4234-aaad-a7f43b8d0b2f req-2fbd7f7d-e1d8-4d08-aa87-3251db4aac78 service nova] Acquiring lock "eab947f6-fbac-4685-adc7-722206413b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ddc64253-a23f-4234-aaad-a7f43b8d0b2f req-2fbd7f7d-e1d8-4d08-aa87-3251db4aac78 service nova] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ddc64253-a23f-4234-aaad-a7f43b8d0b2f req-2fbd7f7d-e1d8-4d08-aa87-3251db4aac78 service nova] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-ddc64253-a23f-4234-aaad-a7f43b8d0b2f req-2fbd7f7d-e1d8-4d08-aa87-3251db4aac78 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] No waiting events found dispatching network-vif-plugged-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:38:16 user nova-compute[75017]: WARNING nova.compute.manager [req-ddc64253-a23f-4234-aaad-a7f43b8d0b2f req-2fbd7f7d-e1d8-4d08-aa87-3251db4aac78 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received unexpected event network-vif-plugged-5a158522-5fa3-4331-9ded-b6a4aead610b for instance with vm_state building and task_state spawning.
Oct 30 09:38:17 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:17 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:38:18 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Instance spawned successfully.
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-75c95ee7-43d7-46bc-82d3-9a8d3475706d req-a2b2a3a8-fc81-43cb-bd98-12fe891d86b8 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received event network-vif-plugged-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-75c95ee7-43d7-46bc-82d3-9a8d3475706d req-a2b2a3a8-fc81-43cb-bd98-12fe891d86b8 service nova] Acquiring lock "eab947f6-fbac-4685-adc7-722206413b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-75c95ee7-43d7-46bc-82d3-9a8d3475706d req-a2b2a3a8-fc81-43cb-bd98-12fe891d86b8 service nova] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-75c95ee7-43d7-46bc-82d3-9a8d3475706d req-a2b2a3a8-fc81-43cb-bd98-12fe891d86b8 service nova] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-75c95ee7-43d7-46bc-82d3-9a8d3475706d req-a2b2a3a8-fc81-43cb-bd98-12fe891d86b8 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] No waiting events found dispatching network-vif-plugged-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:38:18 user nova-compute[75017]: WARNING nova.compute.manager [req-75c95ee7-43d7-46bc-82d3-9a8d3475706d req-a2b2a3a8-fc81-43cb-bd98-12fe891d86b8 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received unexpected event network-vif-plugged-5a158522-5fa3-4331-9ded-b6a4aead610b for instance with vm_state building and task_state spawning.
Oct 30 09:38:18 user nova-compute[75017]: INFO nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Took 5.82 seconds to spawn the instance on the hypervisor.
Oct 30 09:38:18 user nova-compute[75017]: DEBUG nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:38:18 user nova-compute[75017]: INFO nova.compute.manager [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Took 6.46 seconds to build instance.
Oct 30 09:38:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-2a8c8ffc-f6a7-4fd9-9542-4adf7e8c8416 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "eab947f6-fbac-4685-adc7-722206413b8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.595s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-163d042c-389e-4b62-aff9-1a118f250932 req-a9cdb5ea-0cab-44a8-8bc3-1cfe54f54114 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received event network-changed-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-163d042c-389e-4b62-aff9-1a118f250932 req-a9cdb5ea-0cab-44a8-8bc3-1cfe54f54114 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Refreshing instance network info cache due to event network-changed-71ea4c82-7685-4478-9800-11fd83be5383. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-163d042c-389e-4b62-aff9-1a118f250932 req-a9cdb5ea-0cab-44a8-8bc3-1cfe54f54114 service nova] Acquiring lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-163d042c-389e-4b62-aff9-1a118f250932 req-a9cdb5ea-0cab-44a8-8bc3-1cfe54f54114 service nova] Acquired lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG nova.network.neutron [req-163d042c-389e-4b62-aff9-1a118f250932 req-a9cdb5ea-0cab-44a8-8bc3-1cfe54f54114 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Refreshing network info cache for port 71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:28 user nova-compute[75017]: INFO nova.compute.manager [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Terminating instance
Oct 30 09:38:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8027ad43-c14d-4819-b9fc-010c57103006 req-8bbc977b-d60c-428a-8699-e2dd3ec21f13 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received event network-vif-unplugged-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8027ad43-c14d-4819-b9fc-010c57103006 req-8bbc977b-d60c-428a-8699-e2dd3ec21f13 service nova] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8027ad43-c14d-4819-b9fc-010c57103006 req-8bbc977b-d60c-428a-8699-e2dd3ec21f13 service nova] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8027ad43-c14d-4819-b9fc-010c57103006 req-8bbc977b-d60c-428a-8699-e2dd3ec21f13 service nova] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8027ad43-c14d-4819-b9fc-010c57103006 req-8bbc977b-d60c-428a-8699-e2dd3ec21f13 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] No waiting events found dispatching network-vif-unplugged-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-8027ad43-c14d-4819-b9fc-010c57103006 req-8bbc977b-d60c-428a-8699-e2dd3ec21f13 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received event network-vif-unplugged-71ea4c82-7685-4478-9800-11fd83be5383 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:38:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Instance destroyed successfully.
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.objects.instance [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lazy-loading 'resources' on Instance uuid bfbdfdec-fa8f-4c30-999b-8975cbfc37ef {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1564502954',display_name='tempest-TestStampPattern-server-1564502954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1564502954',id=36,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn4YBrWT+oXcMf0FPfsei5t/kRlFe3zwa88mbl5XB02JUbxKsTrVMHZBihz5S+PsRa4KWSStTjiCQfgLkYHyr/M3IBxUs5GEFYj004rG0vhFW1t4jvvI3x4alcHZMrm+A==',key_name='tempest-TestStampPattern-619789116',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10cb9c81a01a44079a469bb6aea845cc',ramdisk_id='',reservation_id='r-5mg9ycjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1711313576',owner_user_name='tempest-TestStampPattern-1711313576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:34:05Z,user_data=None,user_id='4829e2b76b044474a226ba8a6a48a393',uuid=bfbdfdec-fa8f-4c30-999b-8975cbfc37ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converting VIF {"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:55:17,bridge_name='br-int',has_traffic_filtering=True,id=71ea4c82-7685-4478-9800-11fd83be5383,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ea4c82-76') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG os_vif [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:55:17,bridge_name='br-int',has_traffic_filtering=True,id=71ea4c82-7685-4478-9800-11fd83be5383,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ea4c82-76') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71ea4c82-76, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d7cc567-f508-4b8c-8df4-9a075766ee2c) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:38:29 user nova-compute[75017]: INFO os_vif [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:55:17,bridge_name='br-int',has_traffic_filtering=True,id=71ea4c82-7685-4478-9800-11fd83be5383,network=Network(0e97f22f-11d2-4682-a203-2fe6f9cba628),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ea4c82-76')
Oct 30 09:38:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Deleting instance files /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef_del
Oct 30 09:38:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Deletion of /opt/stack/data/nova/instances/bfbdfdec-fa8f-4c30-999b-8975cbfc37ef_del complete
Oct 30 09:38:29 user nova-compute[75017]: INFO nova.compute.manager [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 30 09:38:29 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-163d042c-389e-4b62-aff9-1a118f250932 req-a9cdb5ea-0cab-44a8-8bc3-1cfe54f54114 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updated VIF entry in instance network info cache for port 71ea4c82-7685-4478-9800-11fd83be5383. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-163d042c-389e-4b62-aff9-1a118f250932 req-a9cdb5ea-0cab-44a8-8bc3-1cfe54f54114 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updating instance_info_cache with network_info: [{"id": "71ea4c82-7685-4478-9800-11fd83be5383", "address": "fa:16:3e:e2:55:17", "network": {"id": "0e97f22f-11d2-4682-a203-2fe6f9cba628", "bridge": "br-int", "label": "tempest-TestStampPattern-1846728643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10cb9c81a01a44079a469bb6aea845cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ea4c82-76", "ovs_interfaceid": "71ea4c82-7685-4478-9800-11fd83be5383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-163d042c-389e-4b62-aff9-1a118f250932 req-a9cdb5ea-0cab-44a8-8bc3-1cfe54f54114 service nova] Releasing lock "refresh_cache-bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:38:29 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Took 0.54 seconds to deallocate network for instance.
Oct 30 09:38:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:30 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:38:30 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:38:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:30 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Deleted allocations for instance bfbdfdec-fa8f-4c30-999b-8975cbfc37ef
Oct 30 09:38:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31b44485-2f96-4431-9878-e32547a18f14 tempest-TestStampPattern-1711313576 tempest-TestStampPattern-1711313576-project-member] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.869s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-b2870c1e-6fea-4632-8a1b-55013db99452 req-ed6567fc-86ef-4ebb-a7a3-6330f84696d7 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received event network-vif-deleted-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ed53550-023a-4481-9e8e-8d4244370ff8 req-0609a504-9f09-44cf-9950-1c8a4bbc6b64 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received event network-vif-plugged-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ed53550-023a-4481-9e8e-8d4244370ff8 req-0609a504-9f09-44cf-9950-1c8a4bbc6b64 service nova] Acquiring lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ed53550-023a-4481-9e8e-8d4244370ff8 req-0609a504-9f09-44cf-9950-1c8a4bbc6b64 service nova] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8ed53550-023a-4481-9e8e-8d4244370ff8 req-0609a504-9f09-44cf-9950-1c8a4bbc6b64 service nova] Lock "bfbdfdec-fa8f-4c30-999b-8975cbfc37ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-8ed53550-023a-4481-9e8e-8d4244370ff8 req-0609a504-9f09-44cf-9950-1c8a4bbc6b64 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] No waiting events found dispatching network-vif-plugged-71ea4c82-7685-4478-9800-11fd83be5383 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:38:31 user nova-compute[75017]: WARNING nova.compute.manager [req-8ed53550-023a-4481-9e8e-8d4244370ff8 req-0609a504-9f09-44cf-9950-1c8a4bbc6b64 service nova] [instance: bfbdfdec-fa8f-4c30-999b-8975cbfc37ef] Received unexpected event network-vif-plugged-71ea4c82-7685-4478-9800-11fd83be5383 for instance with vm_state deleted and task_state None.
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:33 user nova-compute[75017]: INFO nova.compute.manager [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Unshelving
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'pci_requests' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'numa_topology' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:38:33 user nova-compute[75017]: INFO nova.compute.claims [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Claim successful on node user
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.039s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:33 user nova-compute[75017]: INFO nova.network.neutron [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updating port f6900dc8-c212-4060-8612-2b818a0912c5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:34 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:38:34 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:38:34 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=24.922828674316406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquired lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-2040f499-5312-4b6d-a70b-24f1f5238aac req-03d700d9-c537-42f1-ae63-3bc9129693a8 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-changed-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-2040f499-5312-4b6d-a70b-24f1f5238aac req-03d700d9-c537-42f1-ae63-3bc9129693a8 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Refreshing instance network info cache due to event network-changed-f6900dc8-c212-4060-8612-2b818a0912c5. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2040f499-5312-4b6d-a70b-24f1f5238aac req-03d700d9-c537-42f1-ae63-3bc9129693a8 service nova] Acquiring lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (f288afb1-3149-4266-a22d-d1442c72ffe3): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updating instance_info_cache with network_info: [{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Releasing lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:38:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Creating image(s)
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'trusted_certs' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2040f499-5312-4b6d-a70b-24f1f5238aac req-03d700d9-c537-42f1-ae63-3bc9129693a8 service nova] Acquired lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.network.neutron [req-2040f499-5312-4b6d-a70b-24f1f5238aac req-03d700d9-c537-42f1-ae63-3bc9129693a8 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Refreshing network info cache for port f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG nova.objects.base [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<d74e1f4c-b89b-4104-9611-0a2870f8d0ec> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "93374d8f65a1dec126e646ce3bb973d4239bd2cc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "93374d8f65a1dec126e646ce3bb973d4239bd2cc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG nova.virt.images [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] 76b0cff6-b008-497c-83c0-852a3870cadb was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc.part /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-2040f499-5312-4b6d-a70b-24f1f5238aac req-03d700d9-c537-42f1-ae63-3bc9129693a8 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updated VIF entry in instance network info cache for port f6900dc8-c212-4060-8612-2b818a0912c5. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-2040f499-5312-4b6d-a70b-24f1f5238aac req-03d700d9-c537-42f1-ae63-3bc9129693a8 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updating instance_info_cache with network_info: [{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:38:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2040f499-5312-4b6d-a70b-24f1f5238aac req-03d700d9-c537-42f1-ae63-3bc9129693a8 service nova] Releasing lock "refresh_cache-d74e1f4c-b89b-4104-9611-0a2870f8d0ec" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc.part /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc.converted" returned: 0 in 0.364s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "93374d8f65a1dec126e646ce3bb973d4239bd2cc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.841s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "93374d8f65a1dec126e646ce3bb973d4239bd2cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "93374d8f65a1dec126e646ce3bb973d4239bd2cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc,backing_fmt=raw /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc,backing_fmt=raw /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk 1073741824" returned: 0 in 0.059s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "93374d8f65a1dec126e646ce3bb973d4239bd2cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'migration_context' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:38:37 user nova-compute[75017]: DEBUG nova.objects.base [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<d74e1f4c-b89b-4104-9611-0a2870f8d0ec> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:38:37 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Rebasing disk image.
Oct 30 09:38:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 -F raw /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:38:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:38:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 -F raw /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk" returned: 0 in 2.410s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Ensure instance console log exists: /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Start _get_guest_xml network_info=[{"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6ba506ba8515203dbf7d8d57d4110af2',container_format='bare',created_at=2023-10-30T09:36:40Z,direct_url=<?>,disk_format='qcow2',id=76b0cff6-b008-497c-83c0-852a3870cadb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1543175365-shelved',owner='2d796755933441bfaff1fb821cc2ad9a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T09:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:38:40 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:38:40 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6ba506ba8515203dbf7d8d57d4110af2',container_format='bare',created_at=2023-10-30T09:36:40Z,direct_url=<?>,disk_format='qcow2',id=76b0cff6-b008-497c-83c0-852a3870cadb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1543175365-shelved',owner='2d796755933441bfaff1fb821cc2ad9a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T09:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'vcpu_model' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.objects.base [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<d74e1f4c-b89b-4104-9611-0a2870f8d0ec> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1543175365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1543175365',id=41,image_ref='76b0cff6-b008-497c-83c0-852a3870cadb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1093075271',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-6ol7na3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member',shelved_at='2023-10-30T09:36:44.608116',shelved_host='user',shelved_image_id='76b0cff6-b008-497c-83c0-852a3870cadb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=d74e1f4c-b89b-4104-9611-0a2870f8d0ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'pci_devices' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.objects.base [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Object Instance<d74e1f4c-b89b-4104-9611-0a2870f8d0ec> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:38:40 user nova-compute[75017]:   <uuid>d74e1f4c-b89b-4104-9611-0a2870f8d0ec</uuid>
Oct 30 09:38:40 user nova-compute[75017]:   <name>instance-00000029</name>
Oct 30 09:38:40 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:38:40 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:38:40 user nova-compute[75017]:   <metadata>
Oct 30 09:38:40 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:38:40 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:38:40 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1543175365</nova:name>
Oct 30 09:38:40 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:38:40</nova:creationTime>
Oct 30 09:38:40 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:38:40 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:38:40 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:38:40 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:38:40 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:38:40 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:38:40 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:38:40 user nova-compute[75017]:       <nova:owner>
Oct 30 09:38:40 user nova-compute[75017]:         <nova:user uuid="57fc74a319ac45e4b8f9f14b172d5e17">tempest-AttachVolumeShelveTestJSON-1409612729-project-member</nova:user>
Oct 30 09:38:40 user nova-compute[75017]:         <nova:project uuid="2d796755933441bfaff1fb821cc2ad9a">tempest-AttachVolumeShelveTestJSON-1409612729</nova:project>
Oct 30 09:38:40 user nova-compute[75017]:       </nova:owner>
Oct 30 09:38:40 user nova-compute[75017]:       <nova:root type="image" uuid="76b0cff6-b008-497c-83c0-852a3870cadb"/>
Oct 30 09:38:40 user nova-compute[75017]:       <nova:ports>
Oct 30 09:38:40 user nova-compute[75017]:         <nova:port uuid="f6900dc8-c212-4060-8612-2b818a0912c5">
Oct 30 09:38:40 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 09:38:40 user nova-compute[75017]:         </nova:port>
Oct 30 09:38:40 user nova-compute[75017]:       </nova:ports>
Oct 30 09:38:40 user nova-compute[75017]:     </nova:instance>
Oct 30 09:38:40 user nova-compute[75017]:   </metadata>
Oct 30 09:38:40 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:38:40 user nova-compute[75017]:     <system>
Oct 30 09:38:40 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:38:40 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:38:40 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:38:40 user nova-compute[75017]:       <entry name="serial">d74e1f4c-b89b-4104-9611-0a2870f8d0ec</entry>
Oct 30 09:38:40 user nova-compute[75017]:       <entry name="uuid">d74e1f4c-b89b-4104-9611-0a2870f8d0ec</entry>
Oct 30 09:38:40 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:38:40 user nova-compute[75017]:     </system>
Oct 30 09:38:40 user nova-compute[75017]:   </sysinfo>
Oct 30 09:38:40 user nova-compute[75017]:   <os>
Oct 30 09:38:40 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:38:40 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:38:40 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:38:40 user nova-compute[75017]:   </os>
Oct 30 09:38:40 user nova-compute[75017]:   <features>
Oct 30 09:38:40 user nova-compute[75017]:     <acpi/>
Oct 30 09:38:40 user nova-compute[75017]:     <apic/>
Oct 30 09:38:40 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:38:40 user nova-compute[75017]:   </features>
Oct 30 09:38:40 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:38:40 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:38:40 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:38:40 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:38:40 user nova-compute[75017]:   </clock>
Oct 30 09:38:40 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:38:40 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:38:40 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:38:40 user nova-compute[75017]:   </cpu>
Oct 30 09:38:40 user nova-compute[75017]:   <devices>
Oct 30 09:38:40 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:38:40 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:38:40 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk"/>
Oct 30 09:38:40 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:38:40 user nova-compute[75017]:     </disk>
Oct 30 09:38:40 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:38:40 user nova-compute[75017]:       <mac address="fa:16:3e:8d:c5:27"/>
Oct 30 09:38:40 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:38:40 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:38:40 user nova-compute[75017]:       <target dev="tapf6900dc8-c2"/>
Oct 30 09:38:40 user nova-compute[75017]:     </interface>
Oct 30 09:38:40 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:38:40 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/console.log" append="off"/>
Oct 30 09:38:40 user nova-compute[75017]:     </serial>
Oct 30 09:38:40 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:38:40 user nova-compute[75017]:     <video>
Oct 30 09:38:40 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:38:40 user nova-compute[75017]:     </video>
Oct 30 09:38:40 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:38:40 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:38:40 user nova-compute[75017]:     </rng>
Oct 30 09:38:40 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:38:40 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:38:40 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:38:40 user nova-compute[75017]:     </memballoon>
Oct 30 09:38:40 user nova-compute[75017]:   </devices>
Oct 30 09:38:40 user nova-compute[75017]: </domain>
Oct 30 09:38:40 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1543175365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1543175365',id=41,image_ref='76b0cff6-b008-497c-83c0-852a3870cadb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1093075271',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-6ol7na3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member',shelved_at='2023-10-30T09:36:44.608116',shelved_host='user',shelved_image_id='76b0cff6-b008-497c-83c0-852a3870cadb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=d74e1f4c-b89b-4104-9611-0a2870f8d0ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG os_vif [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc770545-e9b1-5844-be98-e399347f9952', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6900dc8-c2, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6900dc8-c2, col_values=(('qos', UUID('dad0d107-07e3-4af4-973a-66dfe7649efe')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6900dc8-c2, col_values=(('external_ids', {'iface-id': 'f6900dc8-c212-4060-8612-2b818a0912c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:c5:27', 'vm-uuid': 'd74e1f4c-b89b-4104-9611-0a2870f8d0ec'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:40 user nova-compute[75017]: INFO os_vif [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2')
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:38:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] No VIF found with MAC fa:16:3e:8d:c5:27, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:38:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:41 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-e674c6a6-2e04-4a90-a318-5ee80226adb5 req-73d6999a-0534-419d-8e15-8b56499a3b8d service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e674c6a6-2e04-4a90-a318-5ee80226adb5 req-73d6999a-0534-419d-8e15-8b56499a3b8d service nova] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e674c6a6-2e04-4a90-a318-5ee80226adb5 req-73d6999a-0534-419d-8e15-8b56499a3b8d service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e674c6a6-2e04-4a90-a318-5ee80226adb5 req-73d6999a-0534-419d-8e15-8b56499a3b8d service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-e674c6a6-2e04-4a90-a318-5ee80226adb5 req-73d6999a-0534-419d-8e15-8b56499a3b8d service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] No waiting events found dispatching network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:38:42 user nova-compute[75017]: WARNING nova.compute.manager [req-e674c6a6-2e04-4a90-a318-5ee80226adb5 req-73d6999a-0534-419d-8e15-8b56499a3b8d service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received unexpected event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 09:38:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:38:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:38:44 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance spawned successfully.
Oct 30 09:38:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-a17ecf94-09bd-4164-9f61-b298734b4caf req-c09998b9-9f52-44f0-9ae0-fecaaa88c04f service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:38:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a17ecf94-09bd-4164-9f61-b298734b4caf req-c09998b9-9f52-44f0-9ae0-fecaaa88c04f service nova] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:38:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a17ecf94-09bd-4164-9f61-b298734b4caf req-c09998b9-9f52-44f0-9ae0-fecaaa88c04f service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:38:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a17ecf94-09bd-4164-9f61-b298734b4caf req-c09998b9-9f52-44f0-9ae0-fecaaa88c04f service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-a17ecf94-09bd-4164-9f61-b298734b4caf req-c09998b9-9f52-44f0-9ae0-fecaaa88c04f service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] No waiting events found dispatching network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:38:44 user nova-compute[75017]: WARNING nova.compute.manager [req-a17ecf94-09bd-4164-9f61-b298734b4caf req-c09998b9-9f52-44f0-9ae0-fecaaa88c04f service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received unexpected event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 09:38:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:38:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ef09f3f6-29eb-406f-a9e5-b7babbf29374 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.695s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:38:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:38:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:38:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:00 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:11 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 469c433e-a055-4b0d-a7f1-902cd5b13707 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:39:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:39:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid eab947f6-fbac-4685-adc7-722206413b8a {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:39:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "469c433e-a055-4b0d-a7f1-902cd5b13707" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "eab947f6-fbac-4685-adc7-722206413b8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "eab947f6-fbac-4685-adc7-722206413b8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "eab947f6-fbac-4685-adc7-722206413b8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:39:15 user nova-compute[75017]: INFO nova.compute.claims [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Claim successful on node user
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:39:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.policy [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c10df82a3ff442769998b70e982ebbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c547c8abc6bd4614983ab093e82bb601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:39:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Creating image(s)
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "/opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "/opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "/opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk 1073741824" returned: 0 in 0.051s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Successfully created port: 72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Cannot resize image /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Ensure instance console log exists: /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Successfully updated port: 72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquired lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-ec28f100-9450-46a9-b2a0-94267fc2d9a8 req-f848d040-58df-4703-acf2-b3c25b1a165a service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received event network-changed-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-ec28f100-9450-46a9-b2a0-94267fc2d9a8 req-f848d040-58df-4703-acf2-b3c25b1a165a service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Refreshing instance network info cache due to event network-changed-72925f7f-38eb-44a2-95a5-5e57b7d693a6. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ec28f100-9450-46a9-b2a0-94267fc2d9a8 req-f848d040-58df-4703-acf2-b3c25b1a165a service nova] Acquiring lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating instance_info_cache with network_info: [{"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Releasing lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Instance network_info: |[{"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ec28f100-9450-46a9-b2a0-94267fc2d9a8 req-f848d040-58df-4703-acf2-b3c25b1a165a service nova] Acquired lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-ec28f100-9450-46a9-b2a0-94267fc2d9a8 req-f848d040-58df-4703-acf2-b3c25b1a165a service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Refreshing network info cache for port 72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Start _get_guest_xml network_info=[{"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:39:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:39:17 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1303515731',display_name='tempest-SnapshotDataIntegrityTests-server-1303515731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1303515731',id=43,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCODsMUfOS3Ke+UbZA5lUyPNeDAaBwk6qVhLAkTNA94kHz26WKyIbbFkQb5lUTWGj+DJEEoyqW96nZMopgGiofYdCJnVo8BqpAbk0FWNO7tmbS4MhTfkdA29c3P/H6roCQ==',key_name='tempest-keypair-1050333528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c547c8abc6bd4614983ab093e82bb601',ramdisk_id='',reservation_id='r-murkgm03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1686524374',owner_user_name='tempest-SnapshotDataIntegrityTests-1686524374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c10df82a3ff442769998b70e982ebbb9',uuid=de224282-93e3-4f0e-a748-4e02efb80c5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Converting VIF {"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=72925f7f-38eb-44a2-95a5-5e57b7d693a6,network=Network(466a97ed-985f-4b35-85a2-25a98f6916ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72925f7f-38') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'pci_devices' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:39:17 user nova-compute[75017]:   <uuid>de224282-93e3-4f0e-a748-4e02efb80c5c</uuid>
Oct 30 09:39:17 user nova-compute[75017]:   <name>instance-0000002b</name>
Oct 30 09:39:17 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:39:17 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:39:17 user nova-compute[75017]:   <metadata>
Oct 30 09:39:17 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:39:17 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:39:17 user nova-compute[75017]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1303515731</nova:name>
Oct 30 09:39:17 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:39:17</nova:creationTime>
Oct 30 09:39:17 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:39:17 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:39:17 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:39:17 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:39:17 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:39:17 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:39:17 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:39:17 user nova-compute[75017]:       <nova:owner>
Oct 30 09:39:17 user nova-compute[75017]:         <nova:user uuid="c10df82a3ff442769998b70e982ebbb9">tempest-SnapshotDataIntegrityTests-1686524374-project-member</nova:user>
Oct 30 09:39:17 user nova-compute[75017]:         <nova:project uuid="c547c8abc6bd4614983ab093e82bb601">tempest-SnapshotDataIntegrityTests-1686524374</nova:project>
Oct 30 09:39:17 user nova-compute[75017]:       </nova:owner>
Oct 30 09:39:17 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:39:17 user nova-compute[75017]:       <nova:ports>
Oct 30 09:39:17 user nova-compute[75017]:         <nova:port uuid="72925f7f-38eb-44a2-95a5-5e57b7d693a6">
Oct 30 09:39:17 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 09:39:17 user nova-compute[75017]:         </nova:port>
Oct 30 09:39:17 user nova-compute[75017]:       </nova:ports>
Oct 30 09:39:17 user nova-compute[75017]:     </nova:instance>
Oct 30 09:39:17 user nova-compute[75017]:   </metadata>
Oct 30 09:39:17 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:39:17 user nova-compute[75017]:     <system>
Oct 30 09:39:17 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:39:17 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:39:17 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:39:17 user nova-compute[75017]:       <entry name="serial">de224282-93e3-4f0e-a748-4e02efb80c5c</entry>
Oct 30 09:39:17 user nova-compute[75017]:       <entry name="uuid">de224282-93e3-4f0e-a748-4e02efb80c5c</entry>
Oct 30 09:39:17 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:39:17 user nova-compute[75017]:     </system>
Oct 30 09:39:17 user nova-compute[75017]:   </sysinfo>
Oct 30 09:39:17 user nova-compute[75017]:   <os>
Oct 30 09:39:17 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:39:17 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:39:17 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:39:17 user nova-compute[75017]:   </os>
Oct 30 09:39:17 user nova-compute[75017]:   <features>
Oct 30 09:39:17 user nova-compute[75017]:     <acpi/>
Oct 30 09:39:17 user nova-compute[75017]:     <apic/>
Oct 30 09:39:17 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:39:17 user nova-compute[75017]:   </features>
Oct 30 09:39:17 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:39:17 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:39:17 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:39:17 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:39:17 user nova-compute[75017]:   </clock>
Oct 30 09:39:17 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:39:17 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:39:17 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:39:17 user nova-compute[75017]:   </cpu>
Oct 30 09:39:17 user nova-compute[75017]:   <devices>
Oct 30 09:39:17 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:39:17 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:39:17 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk"/>
Oct 30 09:39:17 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:39:17 user nova-compute[75017]:     </disk>
Oct 30 09:39:17 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:39:17 user nova-compute[75017]:       <mac address="fa:16:3e:7e:c0:c5"/>
Oct 30 09:39:17 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:39:17 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:39:17 user nova-compute[75017]:       <target dev="tap72925f7f-38"/>
Oct 30 09:39:17 user nova-compute[75017]:     </interface>
Oct 30 09:39:17 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:39:17 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/console.log" append="off"/>
Oct 30 09:39:17 user nova-compute[75017]:     </serial>
Oct 30 09:39:17 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:39:17 user nova-compute[75017]:     <video>
Oct 30 09:39:17 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:39:17 user nova-compute[75017]:     </video>
Oct 30 09:39:17 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:39:17 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:39:17 user nova-compute[75017]:     </rng>
Oct 30 09:39:17 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:39:17 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:39:17 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:39:17 user nova-compute[75017]:     </memballoon>
Oct 30 09:39:17 user nova-compute[75017]:   </devices>
Oct 30 09:39:17 user nova-compute[75017]: </domain>
Oct 30 09:39:17 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1303515731',display_name='tempest-SnapshotDataIntegrityTests-server-1303515731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1303515731',id=43,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCODsMUfOS3Ke+UbZA5lUyPNeDAaBwk6qVhLAkTNA94kHz26WKyIbbFkQb5lUTWGj+DJEEoyqW96nZMopgGiofYdCJnVo8BqpAbk0FWNO7tmbS4MhTfkdA29c3P/H6roCQ==',key_name='tempest-keypair-1050333528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c547c8abc6bd4614983ab093e82bb601',ramdisk_id='',reservation_id='r-murkgm03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1686524374',owner_user_name='tempest-SnapshotDataIntegrityTests-1686524374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c10df82a3ff442769998b70e982ebbb9',uuid=de224282-93e3-4f0e-a748-4e02efb80c5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Converting VIF {"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=72925f7f-38eb-44a2-95a5-5e57b7d693a6,network=Network(466a97ed-985f-4b35-85a2-25a98f6916ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72925f7f-38') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG os_vif [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=72925f7f-38eb-44a2-95a5-5e57b7d693a6,network=Network(466a97ed-985f-4b35-85a2-25a98f6916ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72925f7f-38') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33786692-5c3c-5ba9-b8c7-818e0a52d3ea', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72925f7f-38, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72925f7f-38, col_values=(('qos', UUID('9502ebcd-b7e1-4c90-b13c-59c70ee157b3')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72925f7f-38, col_values=(('external_ids', {'iface-id': '72925f7f-38eb-44a2-95a5-5e57b7d693a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:c0:c5', 'vm-uuid': 'de224282-93e3-4f0e-a748-4e02efb80c5c'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:17 user nova-compute[75017]: INFO os_vif [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=72925f7f-38eb-44a2-95a5-5e57b7d693a6,network=Network(466a97ed-985f-4b35-85a2-25a98f6916ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72925f7f-38')
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No VIF found with MAC fa:16:3e:7e:c0:c5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-ec28f100-9450-46a9-b2a0-94267fc2d9a8 req-f848d040-58df-4703-acf2-b3c25b1a165a service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updated VIF entry in instance network info cache for port 72925f7f-38eb-44a2-95a5-5e57b7d693a6. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-ec28f100-9450-46a9-b2a0-94267fc2d9a8 req-f848d040-58df-4703-acf2-b3c25b1a165a service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating instance_info_cache with network_info: [{"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:39:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ec28f100-9450-46a9-b2a0-94267fc2d9a8 req-f848d040-58df-4703-acf2-b3c25b1a165a service nova] Releasing lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:39:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-17142e67-3fe6-48d5-a19c-f1949d633441 req-a1b1629e-fcf5-4f9d-90a2-95816f982b9c service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received event network-vif-plugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:39:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-17142e67-3fe6-48d5-a19c-f1949d633441 req-a1b1629e-fcf5-4f9d-90a2-95816f982b9c service nova] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-17142e67-3fe6-48d5-a19c-f1949d633441 req-a1b1629e-fcf5-4f9d-90a2-95816f982b9c service nova] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-17142e67-3fe6-48d5-a19c-f1949d633441 req-a1b1629e-fcf5-4f9d-90a2-95816f982b9c service nova] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:19 user nova-compute[75017]: DEBUG nova.compute.manager [req-17142e67-3fe6-48d5-a19c-f1949d633441 req-a1b1629e-fcf5-4f9d-90a2-95816f982b9c service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] No waiting events found dispatching network-vif-plugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:39:19 user nova-compute[75017]: WARNING nova.compute.manager [req-17142e67-3fe6-48d5-a19c-f1949d633441 req-a1b1629e-fcf5-4f9d-90a2-95816f982b9c service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received unexpected event network-vif-plugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 for instance with vm_state building and task_state spawning.
Oct 30 09:39:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:39:21 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Instance spawned successfully.
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:39:21 user nova-compute[75017]: INFO nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-544c2296-35e9-48ae-b5c1-abf6470994eb req-6cfe2de7-f1f3-4889-b48d-e75d23a4dc10 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received event network-vif-plugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-544c2296-35e9-48ae-b5c1-abf6470994eb req-6cfe2de7-f1f3-4889-b48d-e75d23a4dc10 service nova] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-544c2296-35e9-48ae-b5c1-abf6470994eb req-6cfe2de7-f1f3-4889-b48d-e75d23a4dc10 service nova] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-544c2296-35e9-48ae-b5c1-abf6470994eb req-6cfe2de7-f1f3-4889-b48d-e75d23a4dc10 service nova] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG nova.compute.manager [req-544c2296-35e9-48ae-b5c1-abf6470994eb req-6cfe2de7-f1f3-4889-b48d-e75d23a4dc10 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] No waiting events found dispatching network-vif-plugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:39:21 user nova-compute[75017]: WARNING nova.compute.manager [req-544c2296-35e9-48ae-b5c1-abf6470994eb req-6cfe2de7-f1f3-4889-b48d-e75d23a4dc10 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received unexpected event network-vif-plugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 for instance with vm_state building and task_state spawning.
Oct 30 09:39:21 user nova-compute[75017]: INFO nova.compute.manager [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Took 6.39 seconds to build instance.
Oct 30 09:39:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ba0b0505-a2b6-4896-87ca-574b6ac8872b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.494s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:25 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:32 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:34 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:34 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:39:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:39:36 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:39:36 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8480MB free_disk=24.92337417602539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance d74e1f4c-b89b-4104-9611-0a2870f8d0ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:39:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:39:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:39:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:39:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid 469c433e-a055-4b0d-a7f1-902cd5b13707 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updating instance_info_cache with network_info: [{"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:39:40 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:42 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:39:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:39:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:39:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:40:03 user nova-compute[75017]: INFO nova.compute.manager [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] instance snapshotting
Oct 30 09:40:03 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Beginning live snapshot process
Oct 30 09:40:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json -f qcow2 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json -f qcow2 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd99fb7vs/8b5a44dbea8248098195c5f097e2e48f.delta 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd99fb7vs/8b5a44dbea8248098195c5f097e2e48f.delta 1073741824" returned: 0 in 0.049s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:04 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 09:40:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75017) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 09:40:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75017) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 09:40:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 09:40:05 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:40:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd99fb7vs/8b5a44dbea8248098195c5f097e2e48f.delta /opt/stack/data/nova/instances/snapshots/tmpd99fb7vs/8b5a44dbea8248098195c5f097e2e48f {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd99fb7vs/8b5a44dbea8248098195c5f097e2e48f.delta /opt/stack/data/nova/instances/snapshots/tmpd99fb7vs/8b5a44dbea8248098195c5f097e2e48f" returned: 0 in 0.502s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Snapshot extracted, beginning image upload
Oct 30 09:40:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:08 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Snapshot image upload complete
Oct 30 09:40:08 user nova-compute[75017]: INFO nova.compute.manager [None req-51b24651-9b01-46e3-8add-51ff124a2cb5 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Took 5.15 seconds to snapshot the instance on the hypervisor.
Oct 30 09:40:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:40:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:40:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:15 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:40:15 user nova-compute[75017]: INFO nova.compute.claims [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Claim successful on node user
Oct 30 09:40:15 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:40:15 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:40:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:40:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:40:15 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:40:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:40:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:40:15 user nova-compute[75017]: INFO nova.virt.block_device [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Booting with volume snapshot a38611b5-ce47-415e-8e54-8c83c4ba8db8 at /dev/vda
Oct 30 09:40:15 user nova-compute[75017]: DEBUG nova.policy [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd23876ced14c21a33d3c13100323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7428fb3055ac4e39b8e00760816b5bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:40:16 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Successfully created port: 436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:40:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Successfully updated port: 436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "refresh_cache-5bac14ae-f407-43cb-b26f-0bbf6d650688" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquired lock "refresh_cache-5bac14ae-f407-43cb-b26f-0bbf6d650688" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-ef75bb18-7313-48eb-9a92-28cbc76bb248 req-b3c3871a-b5c8-4f8d-8a01-77d9cf583054 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-changed-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-ef75bb18-7313-48eb-9a92-28cbc76bb248 req-b3c3871a-b5c8-4f8d-8a01-77d9cf583054 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Refreshing instance network info cache due to event network-changed-436d6870-22d9-4ab8-972c-939d5e613139. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ef75bb18-7313-48eb-9a92-28cbc76bb248 req-b3c3871a-b5c8-4f8d-8a01-77d9cf583054 service nova] Acquiring lock "refresh_cache-5bac14ae-f407-43cb-b26f-0bbf6d650688" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Updating instance_info_cache with network_info: [{"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Releasing lock "refresh_cache-5bac14ae-f407-43cb-b26f-0bbf6d650688" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Instance network_info: |[{"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ef75bb18-7313-48eb-9a92-28cbc76bb248 req-b3c3871a-b5c8-4f8d-8a01-77d9cf583054 service nova] Acquired lock "refresh_cache-5bac14ae-f407-43cb-b26f-0bbf6d650688" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-ef75bb18-7313-48eb-9a92-28cbc76bb248 req-b3c3871a-b5c8-4f8d-8a01-77d9cf583054 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Refreshing network info cache for port 436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-ef75bb18-7313-48eb-9a92-28cbc76bb248 req-b3c3871a-b5c8-4f8d-8a01-77d9cf583054 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Updated VIF entry in instance network info cache for port 436d6870-22d9-4ab8-972c-939d5e613139. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG nova.network.neutron [req-ef75bb18-7313-48eb-9a92-28cbc76bb248 req-b3c3871a-b5c8-4f8d-8a01-77d9cf583054 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Updating instance_info_cache with network_info: [{"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:40:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ef75bb18-7313-48eb-9a92-28cbc76bb248 req-b3c3871a-b5c8-4f8d-8a01-77d9cf583054 service nova] Releasing lock "refresh_cache-5bac14ae-f407-43cb-b26f-0bbf6d650688" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG os_brick.utils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ddd5a1-fa2b-4110-b7a4-e3634a9c41ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d65b8-7807-4e79-a4dc-f84e99e22e83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d988831-6322-4d59-8257-0f5f6d1b1703]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea4649a-f17b-472f-928e-ac19a0df0164]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:40:21 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:40:21 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48f07f3-2610-4ff9-bdc4-96279681af33]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG os_brick.utils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Updating existing volume attachment record: 23a95596-1323-4fc0-9779-3cd42b2010fa {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:40:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:23 user nova-compute[75017]: INFO nova.compute.manager [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Terminating instance
Oct 30 09:40:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-26a74844-1ea3-4761-91aa-1765a770b968 req-10e5fea6-b9c8-431c-af14-3ceb37ed1697 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-unplugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-26a74844-1ea3-4761-91aa-1765a770b968 req-10e5fea6-b9c8-431c-af14-3ceb37ed1697 service nova] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-26a74844-1ea3-4761-91aa-1765a770b968 req-10e5fea6-b9c8-431c-af14-3ceb37ed1697 service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-26a74844-1ea3-4761-91aa-1765a770b968 req-10e5fea6-b9c8-431c-af14-3ceb37ed1697 service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-26a74844-1ea3-4761-91aa-1765a770b968 req-10e5fea6-b9c8-431c-af14-3ceb37ed1697 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] No waiting events found dispatching network-vif-unplugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:40:23 user nova-compute[75017]: DEBUG nova.compute.manager [req-26a74844-1ea3-4761-91aa-1765a770b968 req-10e5fea6-b9c8-431c-af14-3ceb37ed1697 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-unplugged-f6900dc8-c212-4060-8612-2b818a0912c5 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:40:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Instance destroyed successfully.
Oct 30 09:40:24 user nova-compute[75017]: DEBUG nova.objects.instance [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lazy-loading 'resources' on Instance uuid d74e1f4c-b89b-4104-9611-0a2870f8d0ec {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1543175365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1543175365',id=41,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbhc/J2RhKcyGsZnv/Wb9vaAsjwFTR/gt63CZjK7jMYs0Mt3yrGE6pklvE8SdT3UJkNVsJU54rZHi2TbCExh8j+wG3OWvK8+6DAtlHMbL2ONsSjBVxMfGxh9RICXdcoBg==',key_name='tempest-keypair-1093075271',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:38:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d796755933441bfaff1fb821cc2ad9a',ramdisk_id='',reservation_id='r-6ol7na3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1409612729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1409612729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:38:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57fc74a319ac45e4b8f9f14b172d5e17',uuid=d74e1f4c-b89b-4104-9611-0a2870f8d0ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converting VIF {"id": "f6900dc8-c212-4060-8612-2b818a0912c5", "address": "fa:16:3e:8d:c5:27", "network": {"id": "4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1449857593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d796755933441bfaff1fb821cc2ad9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6900dc8-c2", "ovs_interfaceid": "f6900dc8-c212-4060-8612-2b818a0912c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG os_vif [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6900dc8-c2, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dad0d107-07e3-4af4-973a-66dfe7649efe) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:24 user nova-compute[75017]: INFO os_vif [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c5:27,bridge_name='br-int',has_traffic_filtering=True,id=f6900dc8-c212-4060-8612-2b818a0912c5,network=Network(4239e106-f2fe-4f2b-9a02-2fb56ac2e9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6900dc8-c2')
Oct 30 09:40:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Deleting instance files /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec_del
Oct 30 09:40:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Deletion of /opt/stack/data/nova/instances/d74e1f4c-b89b-4104-9611-0a2870f8d0ec_del complete
Oct 30 09:40:24 user nova-compute[75017]: INFO nova.compute.manager [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 30 09:40:24 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:40:24 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:40:25 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Took 1.21 seconds to deallocate network for instance.
Oct 30 09:40:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-576e92cf-e898-4e04-bc3f-d054d5ab44a8 req-30e4e7cf-d13a-4a9f-9a01-751b65148358 service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-deleted-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-49860112-78ae-400e-9b21-dadc97b42f3c req-508c9620-d23b-4c0b-a787-813d104da1fd service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-49860112-78ae-400e-9b21-dadc97b42f3c req-508c9620-d23b-4c0b-a787-813d104da1fd service nova] Acquiring lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-49860112-78ae-400e-9b21-dadc97b42f3c req-508c9620-d23b-4c0b-a787-813d104da1fd service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-49860112-78ae-400e-9b21-dadc97b42f3c req-508c9620-d23b-4c0b-a787-813d104da1fd service nova] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-49860112-78ae-400e-9b21-dadc97b42f3c req-508c9620-d23b-4c0b-a787-813d104da1fd service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] No waiting events found dispatching network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:40:25 user nova-compute[75017]: WARNING nova.compute.manager [req-49860112-78ae-400e-9b21-dadc97b42f3c req-508c9620-d23b-4c0b-a787-813d104da1fd service nova] [instance: d74e1f4c-b89b-4104-9611-0a2870f8d0ec] Received unexpected event network-vif-plugged-f6900dc8-c212-4060-8612-2b818a0912c5 for instance with vm_state deleted and task_state None.
Oct 30 09:40:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:25 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Deleted allocations for instance d74e1f4c-b89b-4104-9611-0a2870f8d0ec
Oct 30 09:40:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-af85a36d-a1f7-42d5-9de0-36d9c2ea5326 tempest-AttachVolumeShelveTestJSON-1409612729 tempest-AttachVolumeShelveTestJSON-1409612729-project-member] Lock "d74e1f4c-b89b-4104-9611-0a2870f8d0ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.515s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:27 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:31 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:40:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:35 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:40:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:35 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:37 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:40:37 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8595MB free_disk=24.864421844482422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5bac14ae-f407-43cb-b26f-0bbf6d650688 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:40:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:40:39 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Creating image(s)
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Ensure instance console log exists: /opt/stack/data/nova/instances/5bac14ae-f407-43cb-b26f-0bbf6d650688/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Start _get_guest_xml network_info=[{"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgEHypmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5bac14ae-f407-43cb-b26f-0bbf6d650688', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7d22754-4708-472c-a697-1d71b84e0efe', 'serial': 'b7d22754-4708-472c-a697-1d71b84e0efe'}, 'disk_bus': 'virtio', 'attachment_id': '23a95596-1323-4fc0-9779-3cd42b2010fa', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:40:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:40:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgEHypmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:40:39 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:40:39 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:40:39 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff02b3f-1b28-429c-963d-59b422d30096]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:40:39 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[954cfa5c-6549-4d58-8341-0c624903df61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe] added
Oct 30 09:40:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43ef576-a3f7-4a1e-aaaa-a74d1df460cb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4020d1-b23e-4237-ab73-0178e489052e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgEHypmV {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgEHypmV" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c775c9-925b-4988-9240-15701dabb49f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fgEHypmV'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc06faaa-231b-4987-94c4-54790023ce85]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[065325d0-e665-4a6d-8ef3-207d7e6618b6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:40:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:40:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:40:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a82c18-e259-4e43-8551-e1c0bc721e2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe, portal: 172.16.0.220,3260]
Oct 30 09:40:40 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe, portal: 172.16.0.220,3260] successful.
Oct 30 09:40:40 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080dec2-98af-473a-81cc-55b574d7a346]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1179be0-31cf-4c1f-bd44-2032b00e2ea7]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:40:40 user nova-compute[75017]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)
Oct 30 09:40:40 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:40:40 user nova-compute[75017]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)
Oct 30 09:40:40 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2108bf-c5de-4041-9ad8-9ee50822ac47]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgEHypmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updating instance_info_cache with network_info: [{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:40:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23936326539623232', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936326539623232', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1632823478',display_name='tempest-TestVolumeBootPattern-server-1632823478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1632823478',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-5vgvn6uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:40:16Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=5bac14ae-f407-43cb-b26f-0bbf6d650688,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=436d6870-22d9-4ab8-972c-939d5e613139,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436d6870-22') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bac14ae-f407-43cb-b26f-0bbf6d650688 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:40:41 user nova-compute[75017]:   <uuid>5bac14ae-f407-43cb-b26f-0bbf6d650688</uuid>
Oct 30 09:40:41 user nova-compute[75017]:   <name>instance-0000002c</name>
Oct 30 09:40:41 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:40:41 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:40:41 user nova-compute[75017]:   <metadata>
Oct 30 09:40:41 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:40:41 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:40:41 user nova-compute[75017]:       <nova:name>tempest-TestVolumeBootPattern-server-1632823478</nova:name>
Oct 30 09:40:41 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:40:39</nova:creationTime>
Oct 30 09:40:41 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:40:41 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:40:41 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:40:41 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:40:41 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:40:41 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:40:41 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:40:41 user nova-compute[75017]:       <nova:owner>
Oct 30 09:40:41 user nova-compute[75017]:         <nova:user uuid="5cd23876ced14c21a33d3c13100323a3">tempest-TestVolumeBootPattern-2136848934-project-member</nova:user>
Oct 30 09:40:41 user nova-compute[75017]:         <nova:project uuid="7428fb3055ac4e39b8e00760816b5bb4">tempest-TestVolumeBootPattern-2136848934</nova:project>
Oct 30 09:40:41 user nova-compute[75017]:       </nova:owner>
Oct 30 09:40:41 user nova-compute[75017]:       <nova:ports>
Oct 30 09:40:41 user nova-compute[75017]:         <nova:port uuid="436d6870-22d9-4ab8-972c-939d5e613139">
Oct 30 09:40:41 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 09:40:41 user nova-compute[75017]:         </nova:port>
Oct 30 09:40:41 user nova-compute[75017]:       </nova:ports>
Oct 30 09:40:41 user nova-compute[75017]:     </nova:instance>
Oct 30 09:40:41 user nova-compute[75017]:   </metadata>
Oct 30 09:40:41 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:40:41 user nova-compute[75017]:     <system>
Oct 30 09:40:41 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:40:41 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:40:41 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:40:41 user nova-compute[75017]:       <entry name="serial">5bac14ae-f407-43cb-b26f-0bbf6d650688</entry>
Oct 30 09:40:41 user nova-compute[75017]:       <entry name="uuid">5bac14ae-f407-43cb-b26f-0bbf6d650688</entry>
Oct 30 09:40:41 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:40:41 user nova-compute[75017]:     </system>
Oct 30 09:40:41 user nova-compute[75017]:   </sysinfo>
Oct 30 09:40:41 user nova-compute[75017]:   <os>
Oct 30 09:40:41 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:40:41 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:40:41 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:40:41 user nova-compute[75017]:   </os>
Oct 30 09:40:41 user nova-compute[75017]:   <features>
Oct 30 09:40:41 user nova-compute[75017]:     <acpi/>
Oct 30 09:40:41 user nova-compute[75017]:     <apic/>
Oct 30 09:40:41 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:40:41 user nova-compute[75017]:   </features>
Oct 30 09:40:41 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:40:41 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:40:41 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:40:41 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:40:41 user nova-compute[75017]:   </clock>
Oct 30 09:40:41 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:40:41 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:40:41 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:40:41 user nova-compute[75017]:   </cpu>
Oct 30 09:40:41 user nova-compute[75017]:   <devices>
Oct 30 09:40:41 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:40:41 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:40:41 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:40:41 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:40:41 user nova-compute[75017]:       <serial>b7d22754-4708-472c-a697-1d71b84e0efe</serial>
Oct 30 09:40:41 user nova-compute[75017]:     </disk>
Oct 30 09:40:41 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:40:41 user nova-compute[75017]:       <mac address="fa:16:3e:ec:c0:bf"/>
Oct 30 09:40:41 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:40:41 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:40:41 user nova-compute[75017]:       <target dev="tap436d6870-22"/>
Oct 30 09:40:41 user nova-compute[75017]:     </interface>
Oct 30 09:40:41 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:40:41 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/5bac14ae-f407-43cb-b26f-0bbf6d650688/console.log" append="off"/>
Oct 30 09:40:41 user nova-compute[75017]:     </serial>
Oct 30 09:40:41 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:40:41 user nova-compute[75017]:     <video>
Oct 30 09:40:41 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:40:41 user nova-compute[75017]:     </video>
Oct 30 09:40:41 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:40:41 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:40:41 user nova-compute[75017]:     </rng>
Oct 30 09:40:41 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:40:41 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:40:41 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:40:41 user nova-compute[75017]:     </memballoon>
Oct 30 09:40:41 user nova-compute[75017]:   </devices>
Oct 30 09:40:41 user nova-compute[75017]: </domain>
Oct 30 09:40:41 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1632823478',display_name='tempest-TestVolumeBootPattern-server-1632823478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1632823478',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-5vgvn6uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:40:16Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=5bac14ae-f407-43cb-b26f-0bbf6d650688,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=436d6870-22d9-4ab8-972c-939d5e613139,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436d6870-22') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG os_vif [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=436d6870-22d9-4ab8-972c-939d5e613139,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436d6870-22') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a963ecc1-9efa-5242-b8ae-d738c43ee2c9', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap436d6870-22, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap436d6870-22, col_values=(('qos', UUID('1049a3f2-fb94-40c3-806d-9c88e82d8381')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap436d6870-22, col_values=(('external_ids', {'iface-id': '436d6870-22d9-4ab8-972c-939d5e613139', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:c0:bf', 'vm-uuid': '5bac14ae-f407-43cb-b26f-0bbf6d650688'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:41 user nova-compute[75017]: INFO os_vif [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=436d6870-22d9-4ab8-972c-939d5e613139,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436d6870-22')
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:40:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No VIF found with MAC fa:16:3e:ec:c0:bf, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:40:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-3fdd77a7-a089-414f-b647-5fa256f4a556 req-fa3ecc0d-e822-476c-bbd9-2a86f12d6176 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:40:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3fdd77a7-a089-414f-b647-5fa256f4a556 req-fa3ecc0d-e822-476c-bbd9-2a86f12d6176 service nova] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3fdd77a7-a089-414f-b647-5fa256f4a556 req-fa3ecc0d-e822-476c-bbd9-2a86f12d6176 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3fdd77a7-a089-414f-b647-5fa256f4a556 req-fa3ecc0d-e822-476c-bbd9-2a86f12d6176 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:42 user nova-compute[75017]: DEBUG nova.compute.manager [req-3fdd77a7-a089-414f-b647-5fa256f4a556 req-fa3ecc0d-e822-476c-bbd9-2a86f12d6176 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] No waiting events found dispatching network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:40:42 user nova-compute[75017]: WARNING nova.compute.manager [req-3fdd77a7-a089-414f-b647-5fa256f4a556 req-fa3ecc0d-e822-476c-bbd9-2a86f12d6176 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received unexpected event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 for instance with vm_state building and task_state spawning.
Oct 30 09:40:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:43 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:40:44 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Instance spawned successfully.
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:40:44 user nova-compute[75017]: INFO nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Took 4.96 seconds to spawn the instance on the hypervisor.
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:40:44 user nova-compute[75017]: INFO nova.compute.manager [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Took 29.77 seconds to build instance.
Oct 30 09:40:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c4c19c22-4168-4257-ad30-882622891fc1 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.862s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-4a98510e-12b5-47e3-a170-4a0b39717cdd req-fe2ede48-a826-4db4-8417-3509cd470567 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4a98510e-12b5-47e3-a170-4a0b39717cdd req-fe2ede48-a826-4db4-8417-3509cd470567 service nova] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4a98510e-12b5-47e3-a170-4a0b39717cdd req-fe2ede48-a826-4db4-8417-3509cd470567 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4a98510e-12b5-47e3-a170-4a0b39717cdd req-fe2ede48-a826-4db4-8417-3509cd470567 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:40:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-4a98510e-12b5-47e3-a170-4a0b39717cdd req-fe2ede48-a826-4db4-8417-3509cd470567 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] No waiting events found dispatching network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:40:44 user nova-compute[75017]: WARNING nova.compute.manager [req-4a98510e-12b5-47e3-a170-4a0b39717cdd req-fe2ede48-a826-4db4-8417-3509cd470567 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received unexpected event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 for instance with vm_state active and task_state None.
Oct 30 09:40:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:40:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:41:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-8c130c3c-15d1-4546-a96e-f64ae45ecbac req-38f960aa-3d99-4d68-ab4a-feaced0ea20d service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received event network-changed-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:41:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-8c130c3c-15d1-4546-a96e-f64ae45ecbac req-38f960aa-3d99-4d68-ab4a-feaced0ea20d service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Refreshing instance network info cache due to event network-changed-72925f7f-38eb-44a2-95a5-5e57b7d693a6. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:41:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8c130c3c-15d1-4546-a96e-f64ae45ecbac req-38f960aa-3d99-4d68-ab4a-feaced0ea20d service nova] Acquiring lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:41:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8c130c3c-15d1-4546-a96e-f64ae45ecbac req-38f960aa-3d99-4d68-ab4a-feaced0ea20d service nova] Acquired lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:41:05 user nova-compute[75017]: DEBUG nova.network.neutron [req-8c130c3c-15d1-4546-a96e-f64ae45ecbac req-38f960aa-3d99-4d68-ab4a-feaced0ea20d service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Refreshing network info cache for port 72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:41:06 user nova-compute[75017]: DEBUG nova.network.neutron [req-8c130c3c-15d1-4546-a96e-f64ae45ecbac req-38f960aa-3d99-4d68-ab4a-feaced0ea20d service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updated VIF entry in instance network info cache for port 72925f7f-38eb-44a2-95a5-5e57b7d693a6. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:41:06 user nova-compute[75017]: DEBUG nova.network.neutron [req-8c130c3c-15d1-4546-a96e-f64ae45ecbac req-38f960aa-3d99-4d68-ab4a-feaced0ea20d service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating instance_info_cache with network_info: [{"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:41:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8c130c3c-15d1-4546-a96e-f64ae45ecbac req-38f960aa-3d99-4d68-ab4a-feaced0ea20d service nova] Releasing lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:41:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:12 user nova-compute[75017]: INFO nova.compute.manager [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attaching volume 2425cc70-49ac-4292-8354-cab12084b24e to /dev/vdb
Oct 30 09:41:12 user nova-compute[75017]: DEBUG os_brick.utils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b47da7-63d5-4086-b3e8-8696fd549350]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b520131f-8999-46a7-beb8-0a021b516c2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71252c7-28a2-4c31-bb74-8b609e64f870]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ec22ba-7cd8-4944-8f42-b3c32065830a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:41:12 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:41:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3617fb8-0e31-487f-ad14-08069ddc04df]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG os_brick.utils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:41:12 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating existing volume attachment record: 80958710-c000-46eb-a38d-f9c8658c0d46 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:41:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:41:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:41:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:41:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'soqTDUdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:41:31 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:41:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:41:31 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:41:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:41:31 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:41:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1c87da-d218-4372-93cc-620744e9f551]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:41:31 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b81d3d-1a3c-4455-bcdf-73641ad5fe18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e] added
Oct 30 09:41:31 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:41:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60c705d-38ce-4f88-ac50-978747dce622]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffcb2b9-a370-49ed-ae84-121fbf307c95]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v soqTDUdv {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v soqTDUdv" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f20ce-12bb-40ff-bb58-ba338878e256]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'soqTDUdv'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[54155f7d-8e8b-4ecb-afa0-bbbed8dea5fb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc65a7a-af32-4822-83c6-9e573b0563cd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:41:32 user nova-compute[75017]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)
Oct 30 09:41:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:41:32 user nova-compute[75017]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)
Oct 30 09:41:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d99269c-db12-4b0d-9b97-b247d7b493d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e, portal: 172.16.0.220,3260]
Oct 30 09:41:32 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e, portal: 172.16.0.220,3260] successful.
Oct 30 09:41:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac71d61-45e9-485d-bb6f-8514a647ff6e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1d27a8-a340-4423-893e-11b92fcd5752]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:41:32 user nova-compute[75017]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)
Oct 30 09:41:32 user nova-compute[75017]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e (non-flash)
Oct 30 09:41:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:41:32 user nova-compute[75017]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)
Oct 30 09:41:32 user nova-compute[75017]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e (non-flash)
Oct 30 09:41:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeda5c3-8212-4cf0-aaa4-cf56cefbd113]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:41:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'soqTDUdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:41:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:41:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26262643563376164', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:41:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262643563376164', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:41:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:41:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:41:33 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:41:33 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:41:33 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:41:33 user nova-compute[75017]:   <serial>2425cc70-49ac-4292-8354-cab12084b24e</serial>
Oct 30 09:41:33 user nova-compute[75017]: </disk>
Oct 30 09:41:33 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:41:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:41:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:41:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:41:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No VIF found with MAC fa:16:3e:7e:c0:c5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:41:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b8fd3d80-cc60-4368-bf25-b5900b3ab19b tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.337s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:41:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:41:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:41:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:41:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:41:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:41:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:41:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:41:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:41:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:41:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8460MB free_disk=24.862018585205078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5bac14ae-f407-43cb-b26f-0bbf6d650688 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:41:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:40 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:41:40 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:41:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:41:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:41:40 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:41:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:41 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Updating instance_info_cache with network_info: [{"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:41:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:41:41 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:41:44 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:41:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:41:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:49 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:41:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:49 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:41:49 user nova-compute[75017]: INFO nova.compute.claims [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Claim successful on node user
Oct 30 09:41:50 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:41:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:41:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG nova.policy [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fda3d7725f8465097f0ef2b1abb1989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244a9d4d205d46aa86afe4c739d11557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:41:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Creating image(s)
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "/opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "/opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "/opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk 1073741824" returned: 0 in 0.052s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Successfully created port: 15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Cannot resize image /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Ensure instance console log exists: /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Successfully updated port: 15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquired lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-8787d07f-d9eb-4fc3-97a4-2b3d4fd0fbf4 req-be03f7bd-2315-46c9-94de-d55040ae24b1 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-changed-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-8787d07f-d9eb-4fc3-97a4-2b3d4fd0fbf4 req-be03f7bd-2315-46c9-94de-d55040ae24b1 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Refreshing instance network info cache due to event network-changed-15693dcb-0226-45db-8c67-3a72a18d89b1. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8787d07f-d9eb-4fc3-97a4-2b3d4fd0fbf4 req-be03f7bd-2315-46c9-94de-d55040ae24b1 service nova] Acquiring lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating instance_info_cache with network_info: [{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Releasing lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance network_info: |[{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8787d07f-d9eb-4fc3-97a4-2b3d4fd0fbf4 req-be03f7bd-2315-46c9-94de-d55040ae24b1 service nova] Acquired lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.network.neutron [req-8787d07f-d9eb-4fc3-97a4-2b3d4fd0fbf4 req-be03f7bd-2315-46c9-94de-d55040ae24b1 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Refreshing network info cache for port 15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Start _get_guest_xml network_info=[{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:41:52 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:41:52 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-344788784',display_name='tempest-AttachVolumeTestJSON-server-344788784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-344788784',id=45,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVTBqkedZ8DJcluIuuSR1Rs15YnzXdFIYJW6MeuRFPLbBpZCGoCobvdV+r75RqCnBFUTK/Ud3FmzSHXRcK299KiuruO2+/ng7MI6WYnIozxCe9mRAg6yA2OJX0E7gzgzg==',key_name='tempest-keypair-1729982551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-hejj34d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:41:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=46c70e09-7d64-4488-b20e-7a8d84ddf0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'pci_devices' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:41:52 user nova-compute[75017]:   <uuid>46c70e09-7d64-4488-b20e-7a8d84ddf0e6</uuid>
Oct 30 09:41:52 user nova-compute[75017]:   <name>instance-0000002d</name>
Oct 30 09:41:52 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:41:52 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:41:52 user nova-compute[75017]:   <metadata>
Oct 30 09:41:52 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:41:52 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:41:52 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeTestJSON-server-344788784</nova:name>
Oct 30 09:41:52 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:41:52</nova:creationTime>
Oct 30 09:41:52 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:41:52 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:41:52 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:41:52 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:41:52 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:41:52 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:41:52 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:41:52 user nova-compute[75017]:       <nova:owner>
Oct 30 09:41:52 user nova-compute[75017]:         <nova:user uuid="0fda3d7725f8465097f0ef2b1abb1989">tempest-AttachVolumeTestJSON-1415373227-project-member</nova:user>
Oct 30 09:41:52 user nova-compute[75017]:         <nova:project uuid="244a9d4d205d46aa86afe4c739d11557">tempest-AttachVolumeTestJSON-1415373227</nova:project>
Oct 30 09:41:52 user nova-compute[75017]:       </nova:owner>
Oct 30 09:41:52 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:41:52 user nova-compute[75017]:       <nova:ports>
Oct 30 09:41:52 user nova-compute[75017]:         <nova:port uuid="15693dcb-0226-45db-8c67-3a72a18d89b1">
Oct 30 09:41:52 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:41:52 user nova-compute[75017]:         </nova:port>
Oct 30 09:41:52 user nova-compute[75017]:       </nova:ports>
Oct 30 09:41:52 user nova-compute[75017]:     </nova:instance>
Oct 30 09:41:52 user nova-compute[75017]:   </metadata>
Oct 30 09:41:52 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:41:52 user nova-compute[75017]:     <system>
Oct 30 09:41:52 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:41:52 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:41:52 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:41:52 user nova-compute[75017]:       <entry name="serial">46c70e09-7d64-4488-b20e-7a8d84ddf0e6</entry>
Oct 30 09:41:52 user nova-compute[75017]:       <entry name="uuid">46c70e09-7d64-4488-b20e-7a8d84ddf0e6</entry>
Oct 30 09:41:52 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:41:52 user nova-compute[75017]:     </system>
Oct 30 09:41:52 user nova-compute[75017]:   </sysinfo>
Oct 30 09:41:52 user nova-compute[75017]:   <os>
Oct 30 09:41:52 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:41:52 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:41:52 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:41:52 user nova-compute[75017]:   </os>
Oct 30 09:41:52 user nova-compute[75017]:   <features>
Oct 30 09:41:52 user nova-compute[75017]:     <acpi/>
Oct 30 09:41:52 user nova-compute[75017]:     <apic/>
Oct 30 09:41:52 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:41:52 user nova-compute[75017]:   </features>
Oct 30 09:41:52 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:41:52 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:41:52 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:41:52 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:41:52 user nova-compute[75017]:   </clock>
Oct 30 09:41:52 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:41:52 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:41:52 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:41:52 user nova-compute[75017]:   </cpu>
Oct 30 09:41:52 user nova-compute[75017]:   <devices>
Oct 30 09:41:52 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:41:52 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:41:52 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk"/>
Oct 30 09:41:52 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:41:52 user nova-compute[75017]:     </disk>
Oct 30 09:41:52 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:41:52 user nova-compute[75017]:       <mac address="fa:16:3e:4e:b7:ce"/>
Oct 30 09:41:52 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:41:52 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:41:52 user nova-compute[75017]:       <target dev="tap15693dcb-02"/>
Oct 30 09:41:52 user nova-compute[75017]:     </interface>
Oct 30 09:41:52 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:41:52 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/console.log" append="off"/>
Oct 30 09:41:52 user nova-compute[75017]:     </serial>
Oct 30 09:41:52 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:41:52 user nova-compute[75017]:     <video>
Oct 30 09:41:52 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:41:52 user nova-compute[75017]:     </video>
Oct 30 09:41:52 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:41:52 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:41:52 user nova-compute[75017]:     </rng>
Oct 30 09:41:52 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:41:52 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:41:52 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:41:52 user nova-compute[75017]:     </memballoon>
Oct 30 09:41:52 user nova-compute[75017]:   </devices>
Oct 30 09:41:52 user nova-compute[75017]: </domain>
Oct 30 09:41:52 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-344788784',display_name='tempest-AttachVolumeTestJSON-server-344788784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-344788784',id=45,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVTBqkedZ8DJcluIuuSR1Rs15YnzXdFIYJW6MeuRFPLbBpZCGoCobvdV+r75RqCnBFUTK/Ud3FmzSHXRcK299KiuruO2+/ng7MI6WYnIozxCe9mRAg6yA2OJX0E7gzgzg==',key_name='tempest-keypair-1729982551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-hejj34d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:41:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=46c70e09-7d64-4488-b20e-7a8d84ddf0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG os_vif [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c2ee34a-0597-58cf-88de-aa053cc03702', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15693dcb-02, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15693dcb-02, col_values=(('qos', UUID('a70c9e16-e5f7-42a9-adcf-fa7faade93e4')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15693dcb-02, col_values=(('external_ids', {'iface-id': '15693dcb-0226-45db-8c67-3a72a18d89b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:b7:ce', 'vm-uuid': '46c70e09-7d64-4488-b20e-7a8d84ddf0e6'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:41:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:52 user nova-compute[75017]: INFO os_vif [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02')
Oct 30 09:41:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:41:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No VIF found with MAC fa:16:3e:4e:b7:ce, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:41:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-8787d07f-d9eb-4fc3-97a4-2b3d4fd0fbf4 req-be03f7bd-2315-46c9-94de-d55040ae24b1 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updated VIF entry in instance network info cache for port 15693dcb-0226-45db-8c67-3a72a18d89b1. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:41:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-8787d07f-d9eb-4fc3-97a4-2b3d4fd0fbf4 req-be03f7bd-2315-46c9-94de-d55040ae24b1 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating instance_info_cache with network_info: [{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:41:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8787d07f-d9eb-4fc3-97a4-2b3d4fd0fbf4 req-be03f7bd-2315-46c9-94de-d55040ae24b1 service nova] Releasing lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:41:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-4af0b7d9-d63d-4194-8f42-cdda887f8b1e req-05e7ce02-b0bf-4bae-a622-bc2a0740256b service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:41:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4af0b7d9-d63d-4194-8f42-cdda887f8b1e req-05e7ce02-b0bf-4bae-a622-bc2a0740256b service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4af0b7d9-d63d-4194-8f42-cdda887f8b1e req-05e7ce02-b0bf-4bae-a622-bc2a0740256b service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4af0b7d9-d63d-4194-8f42-cdda887f8b1e req-05e7ce02-b0bf-4bae-a622-bc2a0740256b service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-4af0b7d9-d63d-4194-8f42-cdda887f8b1e req-05e7ce02-b0bf-4bae-a622-bc2a0740256b service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:41:54 user nova-compute[75017]: WARNING nova.compute.manager [req-4af0b7d9-d63d-4194-8f42-cdda887f8b1e req-05e7ce02-b0bf-4bae-a622-bc2a0740256b service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state building and task_state spawning.
Oct 30 09:41:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:55 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:41:56 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance spawned successfully.
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:41:56 user nova-compute[75017]: INFO nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Took 6.19 seconds to spawn the instance on the hypervisor.
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-b4aa9816-11ec-4eb0-b396-ae82e7bea762 req-5e125a6d-ad4d-4f94-bcb4-e0e2bf828cc7 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4aa9816-11ec-4eb0-b396-ae82e7bea762 req-5e125a6d-ad4d-4f94-bcb4-e0e2bf828cc7 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4aa9816-11ec-4eb0-b396-ae82e7bea762 req-5e125a6d-ad4d-4f94-bcb4-e0e2bf828cc7 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4aa9816-11ec-4eb0-b396-ae82e7bea762 req-5e125a6d-ad4d-4f94-bcb4-e0e2bf828cc7 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-b4aa9816-11ec-4eb0-b396-ae82e7bea762 req-5e125a6d-ad4d-4f94-bcb4-e0e2bf828cc7 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:41:56 user nova-compute[75017]: WARNING nova.compute.manager [req-b4aa9816-11ec-4eb0-b396-ae82e7bea762 req-5e125a6d-ad4d-4f94-bcb4-e0e2bf828cc7 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state building and task_state spawning.
Oct 30 09:41:56 user nova-compute[75017]: INFO nova.compute.manager [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Took 7.01 seconds to build instance.
Oct 30 09:41:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f37f9e02-5787-410f-80a0-95b051154a97 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.159s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:41:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "a886d30f-1e63-472c-b740-677cbd44d565" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:42:01 user nova-compute[75017]: INFO nova.compute.claims [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Claim successful on node user
Oct 30 09:42:01 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:42:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:42:01 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:01 user nova-compute[75017]: DEBUG nova.policy [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd734d26551bc41a585d443a24fac0cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ba6409f82447ba9d0f4f56eef88b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:42:01 user nova-compute[75017]: INFO nova.virt.block_device [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Booting with volume-backed-image bfd0d0c2-d64f-40a2-8d8e-991cce6f8585 at /dev/vda
Oct 30 09:42:02 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Successfully created port: 87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:42:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Successfully updated port: 87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquired lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-e5497e45-3dab-400a-9471-685d259bd1c3 req-3ca2bf29-2570-4e89-9ec0-32c48ec02bf6 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-changed-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG nova.compute.manager [req-e5497e45-3dab-400a-9471-685d259bd1c3 req-3ca2bf29-2570-4e89-9ec0-32c48ec02bf6 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Refreshing instance network info cache due to event network-changed-87c0edf5-b2c8-469f-91b9-c73a1dde04a4. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e5497e45-3dab-400a-9471-685d259bd1c3 req-3ca2bf29-2570-4e89-9ec0-32c48ec02bf6 service nova] Acquiring lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Updating instance_info_cache with network_info: [{"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Releasing lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Instance network_info: |[{"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e5497e45-3dab-400a-9471-685d259bd1c3 req-3ca2bf29-2570-4e89-9ec0-32c48ec02bf6 service nova] Acquired lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:42:03 user nova-compute[75017]: DEBUG nova.network.neutron [req-e5497e45-3dab-400a-9471-685d259bd1c3 req-3ca2bf29-2570-4e89-9ec0-32c48ec02bf6 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Refreshing network info cache for port 87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:42:04 user nova-compute[75017]: DEBUG nova.network.neutron [req-e5497e45-3dab-400a-9471-685d259bd1c3 req-3ca2bf29-2570-4e89-9ec0-32c48ec02bf6 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Updated VIF entry in instance network info cache for port 87c0edf5-b2c8-469f-91b9-c73a1dde04a4. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:42:04 user nova-compute[75017]: DEBUG nova.network.neutron [req-e5497e45-3dab-400a-9471-685d259bd1c3 req-3ca2bf29-2570-4e89-9ec0-32c48ec02bf6 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Updating instance_info_cache with network_info: [{"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:42:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e5497e45-3dab-400a-9471-685d259bd1c3 req-3ca2bf29-2570-4e89-9ec0-32c48ec02bf6 service nova] Releasing lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:05 user nova-compute[75017]: INFO nova.compute.manager [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Terminating instance
Oct 30 09:42:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-e12bcdb9-9ad8-404a-ade9-520ce05e630b req-3a2fe6c8-f505-4b3e-b3f0-1483135f8f2b service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-unplugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e12bcdb9-9ad8-404a-ade9-520ce05e630b req-3a2fe6c8-f505-4b3e-b3f0-1483135f8f2b service nova] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e12bcdb9-9ad8-404a-ade9-520ce05e630b req-3a2fe6c8-f505-4b3e-b3f0-1483135f8f2b service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-e12bcdb9-9ad8-404a-ade9-520ce05e630b req-3a2fe6c8-f505-4b3e-b3f0-1483135f8f2b service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-e12bcdb9-9ad8-404a-ade9-520ce05e630b req-3a2fe6c8-f505-4b3e-b3f0-1483135f8f2b service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] No waiting events found dispatching network-vif-unplugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:42:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-e12bcdb9-9ad8-404a-ade9-520ce05e630b req-3a2fe6c8-f505-4b3e-b3f0-1483135f8f2b service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-unplugged-436d6870-22d9-4ab8-972c-939d5e613139 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Instance destroyed successfully.
Oct 30 09:42:06 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'resources' on Instance uuid 5bac14ae-f407-43cb-b26f-0bbf6d650688 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1632823478',display_name='tempest-TestVolumeBootPattern-server-1632823478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1632823478',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:40:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-5vgvn6uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:40:45Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=5bac14ae-f407-43cb-b26f-0bbf6d650688,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "436d6870-22d9-4ab8-972c-939d5e613139", "address": "fa:16:3e:ec:c0:bf", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436d6870-22", "ovs_interfaceid": "436d6870-22d9-4ab8-972c-939d5e613139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=436d6870-22d9-4ab8-972c-939d5e613139,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436d6870-22') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_vif [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=436d6870-22d9-4ab8-972c-939d5e613139,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436d6870-22') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap436d6870-22, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1049a3f2-fb94-40c3-806d-9c88e82d8381) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:42:06 user nova-compute[75017]: INFO os_vif [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=436d6870-22d9-4ab8-972c-939d5e613139,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436d6870-22')
Oct 30 09:42:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgEHypmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:42:06 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[46763541-ea87-4a59-b5a6-a28ecf5f6b6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:42:06 user nova-compute[75017]: No targets found.
Oct 30 09:42:06 user nova-compute[75017]: iSNS:
Oct 30 09:42:06 user nova-compute[75017]: No targets found.
Oct 30 09:42:06 user nova-compute[75017]: STATIC:
Oct 30 09:42:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:42:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:42:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:42:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e
Oct 30 09:42:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:42:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:42:06 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe
Oct 30 09:42:06 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:42:06 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:42:06 user nova-compute[75017]: FIRMWARE:
Oct 30 09:42:06 user nova-compute[75017]: No targets found.
Oct 30 09:42:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:42:06 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:42:06 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[107d3c67-c5a1-4d51-9d00-4133bff0737f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3cda14-86f9-4cbd-958c-aefe7d9ec9ba]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:42:06 user nova-compute[75017]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)
Oct 30 09:42:06 user nova-compute[75017]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e (non-flash)
Oct 30 09:42:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:42:06 user nova-compute[75017]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe (non-flash)
Oct 30 09:42:06 user nova-compute[75017]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e (non-flash)
Oct 30 09:42:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d1cf8a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a91cc7-a8b1-4ae4-9145-6d908fcc53c0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c070f7ec-0952-4cba-b6e2-147d86d8b8dd]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf64f7-3116-42fe-9a82-e04e84488942]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.076s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c89efc-653d-4cdd-b751-24429bdc38b4]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3c7604f1', '/dev/disk/by-id/scsi-23936326539623232', '/dev/disk/by-id/scsi-1SCST_BIO3c7604f1-962e9b220b2664cc') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 09:42:06 user nova-compute[75017]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_3c7604f1
Oct 30 09:42:06 user nova-compute[75017]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23936326539623232
Oct 30 09:42:06 user nova-compute[75017]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO3c7604f1-962e9b220b2664cc
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a8eb0-d77c-4602-8d5e-22fb830003f0]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fca7db-0773-4b1b-a6f3-cc11877071f1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49778e2-232e-4f55-b46d-762238c6189d]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe, portal: 172.16.0.220,3260]
Oct 30 09:42:06 user nova-compute[75017]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe, portal: 172.16.0.220,3260] successful.
Oct 30 09:42:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d22754-4708-472c-a697-1d71b84e0efe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[30675fb2-92d3-4e3c-a354-0dc77ab50736]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== disconnect_volume: return (451ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:42:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:42:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Deleting instance files /opt/stack/data/nova/instances/5bac14ae-f407-43cb-b26f-0bbf6d650688_del
Oct 30 09:42:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Deletion of /opt/stack/data/nova/instances/5bac14ae-f407-43cb-b26f-0bbf6d650688_del complete
Oct 30 09:42:07 user nova-compute[75017]: INFO nova.compute.manager [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Took 1.39 seconds to destroy the instance on the hypervisor.
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:42:07 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Took 0.60 seconds to deallocate network for instance.
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-5bbe67cd-f866-4060-a09f-f1706802d9ca req-9fcfb908-aea5-42db-ac7f-47b7f420929a service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-deleted-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:07 user nova-compute[75017]: INFO nova.compute.manager [req-5bbe67cd-f866-4060-a09f-f1706802d9ca req-9fcfb908-aea5-42db-ac7f-47b7f420929a service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Neutron deleted interface 436d6870-22d9-4ab8-972c-939d5e613139; detaching it from the instance and deleting it from the info cache
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.network.neutron [req-5bbe67cd-f866-4060-a09f-f1706802d9ca req-9fcfb908-aea5-42db-ac7f-47b7f420929a service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-5bbe67cd-f866-4060-a09f-f1706802d9ca req-9fcfb908-aea5-42db-ac7f-47b7f420929a service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Detach interface failed, port_id=436d6870-22d9-4ab8-972c-939d5e613139, reason: Instance 5bac14ae-f407-43cb-b26f-0bbf6d650688 could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] No waiting events found dispatching network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:42:07 user nova-compute[75017]: WARNING nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received unexpected event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 for instance with vm_state active and task_state deleting.
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] No waiting events found dispatching network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:42:07 user nova-compute[75017]: WARNING nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received unexpected event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 for instance with vm_state active and task_state deleting.
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] No waiting events found dispatching network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:42:07 user nova-compute[75017]: WARNING nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received unexpected event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 for instance with vm_state active and task_state deleting.
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-unplugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] No waiting events found dispatching network-vif-unplugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-unplugged-436d6870-22d9-4ab8-972c-939d5e613139 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Acquiring lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] No waiting events found dispatching network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:42:07 user nova-compute[75017]: WARNING nova.compute.manager [req-47282c89-fb4f-408b-979c-ea20e6c3528d req-0c7036c7-136d-4050-94a7-283586ec33d9 service nova] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Received unexpected event network-vif-plugged-436d6870-22d9-4ab8-972c-939d5e613139 for instance with vm_state active and task_state deleting.
Oct 30 09:42:08 user nova-compute[75017]: INFO nova.compute.manager [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Took 0.97 seconds to detach 1 volumes for instance.
Oct 30 09:42:08 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 5bac14ae-f407-43cb-b26f-0bbf6d650688] Deleting volume: b7d22754-4708-472c-a697-1d71b84e0efe {{(pid=75017) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 09:42:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:09 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:42:09 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:42:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:09 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Deleted allocations for instance 5bac14ae-f407-43cb-b26f-0bbf6d650688
Oct 30 09:42:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b9426b73-0fca-445b-ac7d-262cc9e7bb82 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "5bac14ae-f407-43cb-b26f-0bbf6d650688" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.897s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:10 user nova-compute[75017]: INFO nova.compute.manager [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Detaching volume 2425cc70-49ac-4292-8354-cab12084b24e
Oct 30 09:42:10 user nova-compute[75017]: INFO nova.virt.block_device [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attempting to driver detach volume 2425cc70-49ac-4292-8354-cab12084b24e from mountpoint /dev/vdb
Oct 30 09:42:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Attempting to detach device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:42:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:42:10 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:42:10 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:42:10 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:42:10 user nova-compute[75017]:   <serial>2425cc70-49ac-4292-8354-cab12084b24e</serial>
Oct 30 09:42:10 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:42:10 user nova-compute[75017]: </disk>
Oct 30 09:42:10 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:42:10 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully detached device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the persistent domain config.
Oct 30 09:42:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:42:10 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:42:10 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:42:10 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:42:10 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:42:10 user nova-compute[75017]:   <serial>2425cc70-49ac-4292-8354-cab12084b24e</serial>
Oct 30 09:42:10 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:42:10 user nova-compute[75017]: </disk>
Oct 30 09:42:10 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:42:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:42:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG os_brick.utils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeaf199-a821-4fb1-b876-349092725059]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf7a2c3-2573-4ee3-93c4-b54a84ee0fdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b5e09c-8dd6-4ebb-9de7-85182518177d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a8c27-52e6-4948-8f94-4ade9595a250]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:42:22 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:42:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ceb3fb-3b11-41a4-beb9-f2601905db3a]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG os_brick.utils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:42:22 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Updating existing volume attachment record: e507943d-eaa5-449a-b68a-f5ba69d49f99 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:42:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:30 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:31 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de224282-93e3-4f0e-a748-4e02efb80c5c is timed out.
Oct 30 09:42:31 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully detached device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the live domain config.
Oct 30 09:42:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'soqTDUdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:42:31 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b221bd-153a-4645-8d7a-552dbce03dd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:42:31 user nova-compute[75017]: No targets found.
Oct 30 09:42:31 user nova-compute[75017]: iSNS:
Oct 30 09:42:31 user nova-compute[75017]: No targets found.
Oct 30 09:42:31 user nova-compute[75017]: STATIC:
Oct 30 09:42:31 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:42:31 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:42:31 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:42:31 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e
Oct 30 09:42:31 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:42:31 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:42:31 user nova-compute[75017]: FIRMWARE:
Oct 30 09:42:31 user nova-compute[75017]: No targets found.
Oct 30 09:42:31 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:42:31 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:42:31 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[192c72b8-f8e0-4278-bd14-3248eb4a3035]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[32352479-9148-4aff-ba49-7fda0ebe389b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:42:31 user nova-compute[75017]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e (non-flash)
Oct 30 09:42:31 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:42:31 user nova-compute[75017]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e (non-flash)
Oct 30 09:42:31 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccb60ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d20c4ec-fca3-42ac-8898-28a93d547496]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57e6069-4088-480a-90b8-501ab85ed398]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a1b49-f597-4b03-b1b2-87cd9cdfcc9b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc8b5d0-0612-4e31-9b30-fa06982d7623]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c48f9f-689d-47f3-8083-2b3f283210b7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce7859d-ba64-47d0-96ff-9a071a9e3444]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e, portal: 172.16.0.220,3260]
Oct 30 09:42:31 user nova-compute[75017]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e, portal: 172.16.0.220,3260] successful.
Oct 30 09:42:31 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2425cc70-49ac-4292-8354-cab12084b24e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceba11a1-d242-4508-b660-6f2ba377c9eb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== disconnect_volume: return (325ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:42:31 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:42:32 user nova-compute[75017]: DEBUG nova.objects.instance [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:42:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-fc7d26de-1039-4c1c-b32e-eec5dab2f1e5 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.869s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:32 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:34 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:42:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:42:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:42:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:42:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:42:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:37 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:42:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:38 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:42:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8435MB free_disk=24.82278060913086GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance a886d30f-1e63-472c-b740-677cbd44d565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:42:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:42:41 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Creating image(s)
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Ensure instance console log exists: /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Start _get_guest_xml network_info=[{"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsNltWSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a886d30f-1e63-472c-b740-677cbd44d565', 'attached_at': '', 'detached_at': '', 'volume_id': '4d026977-3f87-46bc-952a-96b06135fbda', 'serial': '4d026977-3f87-46bc-952a-96b06135fbda'}, 'disk_bus': 'virtio', 'attachment_id': 'e507943d-eaa5-449a-b68a-f5ba69d49f99', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:42:41 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:42:41 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsNltWSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:42:41 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:42:41 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:42:41 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d702a695-2d4e-4ebf-b221-099a154198d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:42:41 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbc5976-7bf9-43d0-851b-4d254a301c9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda] added
Oct 30 09:42:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4770d98-1b9c-4c07-b0f0-7572ffde5d88]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd48cc72-cc52-4cb9-871d-aa81a0b44590]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsNltWSg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsNltWSg" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8047ea-bede-418e-abbe-86df2ceddd39]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LsNltWSg'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f413c1ef-d24c-4254-9158-06f23a090339]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14d88bc-5b82-4114-ae28-323a70666b21]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:42:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:42:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b165fdd-a523-4e2d-ae30-74681907ca5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda, portal: 172.16.0.220,3260]
Oct 30 09:42:41 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda, portal: 172.16.0.220,3260] successful.
Oct 30 09:42:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[64992e46-16d5-40e6-a943-a151336e04db]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5be27b-ef92-43df-9db2-c83bb07acf94]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:42:41 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:42:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:42:41 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:42:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[40183ec6-abb5-4916-bd3d-68ab6fdec47c]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsNltWSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:41 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23362303665323037', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362303665323037', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:42:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-20992873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-20992873',id=46,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-h516kdcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:42:02Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=a886d30f-1e63-472c-b740-677cbd44d565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:42:70,bridge_name='br-int',has_traffic_filtering=True,id=87c0edf5-b2c8-469f-91b9-c73a1dde04a4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c0edf5-b2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'pci_devices' on Instance uuid a886d30f-1e63-472c-b740-677cbd44d565 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating instance_info_cache with network_info: [{"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:42:42 user nova-compute[75017]:   <uuid>a886d30f-1e63-472c-b740-677cbd44d565</uuid>
Oct 30 09:42:42 user nova-compute[75017]:   <name>instance-0000002e</name>
Oct 30 09:42:42 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:42:42 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:42:42 user nova-compute[75017]:   <metadata>
Oct 30 09:42:42 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:42:42 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:42:42 user nova-compute[75017]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-20992873</nova:name>
Oct 30 09:42:42 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:42:41</nova:creationTime>
Oct 30 09:42:42 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:42:42 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:42:42 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:42:42 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:42:42 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:42:42 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:42:42 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:42:42 user nova-compute[75017]:       <nova:owner>
Oct 30 09:42:42 user nova-compute[75017]:         <nova:user uuid="d734d26551bc41a585d443a24fac0cd8">tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member</nova:user>
Oct 30 09:42:42 user nova-compute[75017]:         <nova:project uuid="76ba6409f82447ba9d0f4f56eef88b1d">tempest-ServerBootFromVolumeStableRescueTest-1506388181</nova:project>
Oct 30 09:42:42 user nova-compute[75017]:       </nova:owner>
Oct 30 09:42:42 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:42:42 user nova-compute[75017]:       <nova:ports>
Oct 30 09:42:42 user nova-compute[75017]:         <nova:port uuid="87c0edf5-b2c8-469f-91b9-c73a1dde04a4">
Oct 30 09:42:42 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 09:42:42 user nova-compute[75017]:         </nova:port>
Oct 30 09:42:42 user nova-compute[75017]:       </nova:ports>
Oct 30 09:42:42 user nova-compute[75017]:     </nova:instance>
Oct 30 09:42:42 user nova-compute[75017]:   </metadata>
Oct 30 09:42:42 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:42:42 user nova-compute[75017]:     <system>
Oct 30 09:42:42 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:42:42 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:42:42 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:42:42 user nova-compute[75017]:       <entry name="serial">a886d30f-1e63-472c-b740-677cbd44d565</entry>
Oct 30 09:42:42 user nova-compute[75017]:       <entry name="uuid">a886d30f-1e63-472c-b740-677cbd44d565</entry>
Oct 30 09:42:42 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:42:42 user nova-compute[75017]:     </system>
Oct 30 09:42:42 user nova-compute[75017]:   </sysinfo>
Oct 30 09:42:42 user nova-compute[75017]:   <os>
Oct 30 09:42:42 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:42:42 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:42:42 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:42:42 user nova-compute[75017]:   </os>
Oct 30 09:42:42 user nova-compute[75017]:   <features>
Oct 30 09:42:42 user nova-compute[75017]:     <acpi/>
Oct 30 09:42:42 user nova-compute[75017]:     <apic/>
Oct 30 09:42:42 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:42:42 user nova-compute[75017]:   </features>
Oct 30 09:42:42 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:42:42 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:42:42 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:42:42 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:42:42 user nova-compute[75017]:   </clock>
Oct 30 09:42:42 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:42:42 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:42:42 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:42:42 user nova-compute[75017]:   </cpu>
Oct 30 09:42:42 user nova-compute[75017]:   <devices>
Oct 30 09:42:42 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:42:42 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:42:42 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:42:42 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:42:42 user nova-compute[75017]:       <serial>4d026977-3f87-46bc-952a-96b06135fbda</serial>
Oct 30 09:42:42 user nova-compute[75017]:     </disk>
Oct 30 09:42:42 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:42:42 user nova-compute[75017]:       <mac address="fa:16:3e:e5:42:70"/>
Oct 30 09:42:42 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:42:42 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:42:42 user nova-compute[75017]:       <target dev="tap87c0edf5-b2"/>
Oct 30 09:42:42 user nova-compute[75017]:     </interface>
Oct 30 09:42:42 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:42:42 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/console.log" append="off"/>
Oct 30 09:42:42 user nova-compute[75017]:     </serial>
Oct 30 09:42:42 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:42:42 user nova-compute[75017]:     <video>
Oct 30 09:42:42 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:42:42 user nova-compute[75017]:     </video>
Oct 30 09:42:42 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:42:42 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:42:42 user nova-compute[75017]:     </rng>
Oct 30 09:42:42 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:42:42 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:42:42 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:42:42 user nova-compute[75017]:     </memballoon>
Oct 30 09:42:42 user nova-compute[75017]:   </devices>
Oct 30 09:42:42 user nova-compute[75017]: </domain>
Oct 30 09:42:42 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:42:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-20992873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-20992873',id=46,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-h516kdcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:42:02Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=a886d30f-1e63-472c-b740-677cbd44d565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:42:70,bridge_name='br-int',has_traffic_filtering=True,id=87c0edf5-b2c8-469f-91b9-c73a1dde04a4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c0edf5-b2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG os_vif [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:42:70,bridge_name='br-int',has_traffic_filtering=True,id=87c0edf5-b2c8-469f-91b9-c73a1dde04a4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c0edf5-b2') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfa4b658-2eef-5e3a-a0aa-dd0c0cec6698', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87c0edf5-b2, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87c0edf5-b2, col_values=(('qos', UUID('0cfe2d24-07f5-40f5-8f08-88cf7c0088f6')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87c0edf5-b2, col_values=(('external_ids', {'iface-id': '87c0edf5-b2c8-469f-91b9-c73a1dde04a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:42:70', 'vm-uuid': 'a886d30f-1e63-472c-b740-677cbd44d565'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:42 user nova-compute[75017]: INFO os_vif [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:42:70,bridge_name='br-int',has_traffic_filtering=True,id=87c0edf5-b2c8-469f-91b9-c73a1dde04a4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c0edf5-b2')
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:42:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No VIF found with MAC fa:16:3e:e5:42:70, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:42:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-c457b734-cdee-4f61-8e20-7d337929a6d5 req-c81d9379-e53d-48e1-9a41-645288befcbd service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c457b734-cdee-4f61-8e20-7d337929a6d5 req-c81d9379-e53d-48e1-9a41-645288befcbd service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c457b734-cdee-4f61-8e20-7d337929a6d5 req-c81d9379-e53d-48e1-9a41-645288befcbd service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c457b734-cdee-4f61-8e20-7d337929a6d5 req-c81d9379-e53d-48e1-9a41-645288befcbd service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-c457b734-cdee-4f61-8e20-7d337929a6d5 req-c81d9379-e53d-48e1-9a41-645288befcbd service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:42:44 user nova-compute[75017]: WARNING nova.compute.manager [req-c457b734-cdee-4f61-8e20-7d337929a6d5 req-c81d9379-e53d-48e1-9a41-645288befcbd service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state building and task_state spawning.
Oct 30 09:42:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:44 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:42:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:42:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:42:45 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Instance spawned successfully.
Oct 30 09:42:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:42:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:42:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:42:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:42:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:42:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:42:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:42:46 user nova-compute[75017]: INFO nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Took 4.92 seconds to spawn the instance on the hypervisor.
Oct 30 09:42:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:42:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-b7e3347f-aae6-4a9f-bc65-72e475e5d883 req-664bbbfb-9d9f-43c1-9ded-4cc6bb9e1919 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:42:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b7e3347f-aae6-4a9f-bc65-72e475e5d883 req-664bbbfb-9d9f-43c1-9ded-4cc6bb9e1919 service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:42:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b7e3347f-aae6-4a9f-bc65-72e475e5d883 req-664bbbfb-9d9f-43c1-9ded-4cc6bb9e1919 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:42:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b7e3347f-aae6-4a9f-bc65-72e475e5d883 req-664bbbfb-9d9f-43c1-9ded-4cc6bb9e1919 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:46 user nova-compute[75017]: DEBUG nova.compute.manager [req-b7e3347f-aae6-4a9f-bc65-72e475e5d883 req-664bbbfb-9d9f-43c1-9ded-4cc6bb9e1919 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:42:46 user nova-compute[75017]: WARNING nova.compute.manager [req-b7e3347f-aae6-4a9f-bc65-72e475e5d883 req-664bbbfb-9d9f-43c1-9ded-4cc6bb9e1919 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state building and task_state spawning.
Oct 30 09:42:46 user nova-compute[75017]: INFO nova.compute.manager [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Took 45.13 seconds to build instance.
Oct 30 09:42:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7231114-3d64-4c2d-bcec-f5de2c4349d4 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "a886d30f-1e63-472c-b740-677cbd44d565" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.289s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:42:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:42:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:42:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:42:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:42:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:42:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:42:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:43:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:06 user nova-compute[75017]: DEBUG nova.objects.instance [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:43:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:07 user nova-compute[75017]: INFO nova.compute.manager [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attaching volume f959ad53-542f-4857-b7fd-e3e329ac7f24 to /dev/vdb
Oct 30 09:43:07 user nova-compute[75017]: DEBUG os_brick.utils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4864245-c99c-42dd-ae96-d98f1025465b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da3b2d-86db-4ef4-b1f9-bece6914a3ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e517f556-3626-433f-8137-79ce39c7b886]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec32398a-cd57-4c85-bbfd-3302d34f97f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:43:07 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:43:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51fbe9a-aea7-4d86-ba23-829698f52bb7]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG os_brick.utils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating existing volume attachment record: 12738baa-93f1-4fe5-9f91-b75872817095 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:43:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:29 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:43:31 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:32 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:32 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKZLTdWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:43:36 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:43:36 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:43:36 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93664dd-22f8-479c-9537-cde5d4eebaa3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:43:36 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3868299e-1bfa-4f04-b6d7-831c0cfa6b91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24] added
Oct 30 09:43:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[47488189-539b-4373-8b1e-d1f6707e35e5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0e2cf3-944e-4bfe-9930-993ba0ac7052]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKZLTdWt {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKZLTdWt" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2fbb27-05a9-4915-af6a-4ca8156dd295]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nKZLTdWt'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4276f96b-dbb5-4e9c-9be7-b90f2db2ba3c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[74665987-dbea-40ca-a540-1a8e35c1e1fc]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:43:36 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:43:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:43:36 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:43:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[441b498a-9237-42c5-b520-769ffec296e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24, portal: 172.16.0.220,3260]
Oct 30 09:43:36 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24, portal: 172.16.0.220,3260] successful.
Oct 30 09:43:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e8edb-faf9-4c51-be26-5da89319bb77]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5c673d-4890-40bb-949d-ab4289e1a8ba]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:43:36 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:43:36 user nova-compute[75017]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 (non-flash)
Oct 30 09:43:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:43:36 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:43:36 user nova-compute[75017]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 (non-flash)
Oct 30 09:43:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b532458e-310b-4b6b-9237-7fcce90934e8]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:43:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKZLTdWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:43:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:43:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:43:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23735383366343166', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:43:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735383366343166', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:43:37 user nova-compute[75017]: DEBUG nova.objects.instance [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:43:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:43:37 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:43:37 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:43:37 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:43:37 user nova-compute[75017]:   <serial>f959ad53-542f-4857-b7fd-e3e329ac7f24</serial>
Oct 30 09:43:37 user nova-compute[75017]: </disk>
Oct 30 09:43:37 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:43:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:43:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:43:38 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No VIF found with MAC fa:16:3e:7e:c0:c5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:43:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-0d2bc011-e6c4-479b-a29d-63633df6ec71 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.446s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-8e3a1804-e87f-43d1-b997-b1a51bf7967d req-ef9ece5d-a562-4c3b-babb-979900b661e5 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-changed-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-8e3a1804-e87f-43d1-b997-b1a51bf7967d req-ef9ece5d-a562-4c3b-babb-979900b661e5 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Refreshing instance network info cache due to event network-changed-15693dcb-0226-45db-8c67-3a72a18d89b1. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8e3a1804-e87f-43d1-b997-b1a51bf7967d req-ef9ece5d-a562-4c3b-babb-979900b661e5 service nova] Acquiring lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8e3a1804-e87f-43d1-b997-b1a51bf7967d req-ef9ece5d-a562-4c3b-babb-979900b661e5 service nova] Acquired lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.network.neutron [req-8e3a1804-e87f-43d1-b997-b1a51bf7967d req-ef9ece5d-a562-4c3b-babb-979900b661e5 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Refreshing network info cache for port 15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:40 user nova-compute[75017]: INFO nova.compute.manager [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Detaching volume f959ad53-542f-4857-b7fd-e3e329ac7f24
Oct 30 09:43:40 user nova-compute[75017]: INFO nova.virt.block_device [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attempting to driver detach volume f959ad53-542f-4857-b7fd-e3e329ac7f24 from mountpoint /dev/vdb
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Attempting to detach device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:43:40 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:43:40 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:43:40 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:43:40 user nova-compute[75017]:   <serial>f959ad53-542f-4857-b7fd-e3e329ac7f24</serial>
Oct 30 09:43:40 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:43:40 user nova-compute[75017]: </disk>
Oct 30 09:43:40 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:43:40 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully detached device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the persistent domain config.
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:43:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:43:40 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:43:40 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:43:40 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:43:40 user nova-compute[75017]:   <serial>f959ad53-542f-4857-b7fd-e3e329ac7f24</serial>
Oct 30 09:43:40 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:43:40 user nova-compute[75017]: </disk>
Oct 30 09:43:40 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-8e3a1804-e87f-43d1-b997-b1a51bf7967d req-ef9ece5d-a562-4c3b-babb-979900b661e5 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updated VIF entry in instance network info cache for port 15693dcb-0226-45db-8c67-3a72a18d89b1. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-8e3a1804-e87f-43d1-b997-b1a51bf7967d req-ef9ece5d-a562-4c3b-babb-979900b661e5 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating instance_info_cache with network_info: [{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8e3a1804-e87f-43d1-b997-b1a51bf7967d req-ef9ece5d-a562-4c3b-babb-979900b661e5 service nova] Releasing lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:43:41 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:43:41 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=24.820419311523438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance a886d30f-1e63-472c-b740-677cbd44d565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:43:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "13d468ad-69a5-409d-b737-188a4f1a7bda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:43:45 user nova-compute[75017]: INFO nova.compute.claims [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Claim successful on node user
Oct 30 09:43:45 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:43:45 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:43:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:43:45 user nova-compute[75017]: INFO nova.virt.block_device [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Booting with volume d78b4332-e3cc-4093-8c0a-bfc6c735b09c at /dev/vda
Oct 30 09:43:45 user nova-compute[75017]: DEBUG nova.policy [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd23876ced14c21a33d3c13100323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7428fb3055ac4e39b8e00760816b5bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG os_brick.utils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc0254a-76e9-4c97-b006-3443fdf62099]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c174e63-a209-4c98-8af9-820b37ca5abc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66d6d2b-e86d-48c8-910f-7b14527280d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1399391b-9138-44d9-9a3d-0ab327362500]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:43:45 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:43:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b67e957-5cac-4b28-9785-d03bc948656b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG os_brick.utils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:43:45 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Updating existing volume attachment record: 605c53ea-3395-4eda-8749-9c6ccaed382c {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Successfully created port: 1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:46 user nova-compute[75017]: INFO nova.compute.manager [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Attaching volume 66122ba3-0e62-46b0-b5a3-0c6594ff58b3 to /dev/vdb
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Successfully updated port: 1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "refresh_cache-13d468ad-69a5-409d-b737-188a4f1a7bda" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquired lock "refresh_cache-13d468ad-69a5-409d-b737-188a4f1a7bda" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG os_brick.utils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f03e5b0-d0c7-48ed-b62b-eb2c29eef8f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-55b9d498-0561-49b2-9d23-0c762af2967d req-23698bef-cfb1-494e-a23f-cb9eaedb5475 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received event network-changed-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-55b9d498-0561-49b2-9d23-0c762af2967d req-23698bef-cfb1-494e-a23f-cb9eaedb5475 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Refreshing instance network info cache due to event network-changed-1a5e045c-628a-4c84-ba60-dae49f823989. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-55b9d498-0561-49b2-9d23-0c762af2967d req-23698bef-cfb1-494e-a23f-cb9eaedb5475 service nova] Acquiring lock "refresh_cache-13d468ad-69a5-409d-b737-188a4f1a7bda" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4fe972-39a2-4dd8-95c7-57854259e06d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79234ab-4449-4e73-a257-68c7d85b4505]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0b031c-834b-480b-b167-6800f2acd398]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:43:47 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[133d4e76-0775-4610-b43d-bda45eabe469]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG os_brick.utils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating existing volume attachment record: b300925b-4f5a-4543-98c6-4521b8bf6e54 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.network.neutron [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Updating instance_info_cache with network_info: [{"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Releasing lock "refresh_cache-13d468ad-69a5-409d-b737-188a4f1a7bda" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Instance network_info: |[{"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-55b9d498-0561-49b2-9d23-0c762af2967d req-23698bef-cfb1-494e-a23f-cb9eaedb5475 service nova] Acquired lock "refresh_cache-13d468ad-69a5-409d-b737-188a4f1a7bda" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.network.neutron [req-55b9d498-0561-49b2-9d23-0c762af2967d req-23698bef-cfb1-494e-a23f-cb9eaedb5475 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Refreshing network info cache for port 1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.network.neutron [req-55b9d498-0561-49b2-9d23-0c762af2967d req-23698bef-cfb1-494e-a23f-cb9eaedb5475 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Updated VIF entry in instance network info cache for port 1a5e045c-628a-4c84-ba60-dae49f823989. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG nova.network.neutron [req-55b9d498-0561-49b2-9d23-0c762af2967d req-23698bef-cfb1-494e-a23f-cb9eaedb5475 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Updating instance_info_cache with network_info: [{"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:43:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-55b9d498-0561-49b2-9d23-0c762af2967d req-23698bef-cfb1-494e-a23f-cb9eaedb5475 service nova] Releasing lock "refresh_cache-13d468ad-69a5-409d-b737-188a4f1a7bda" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:43:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:51 user nova-compute[75017]: INFO nova.compute.manager [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Rescuing
Oct 30 09:43:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:43:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquired lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:43:51 user nova-compute[75017]: DEBUG nova.network.neutron [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Updating instance_info_cache with network_info: [{"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Releasing lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-3195baa4-f6a8-458e-846e-a180832919ee req-e898ae50-e723-460e-93de-53ed79391e6b service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-unplugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3195baa4-f6a8-458e-846e-a180832919ee req-e898ae50-e723-460e-93de-53ed79391e6b service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3195baa4-f6a8-458e-846e-a180832919ee req-e898ae50-e723-460e-93de-53ed79391e6b service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-3195baa4-f6a8-458e-846e-a180832919ee req-e898ae50-e723-460e-93de-53ed79391e6b service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-3195baa4-f6a8-458e-846e-a180832919ee req-e898ae50-e723-460e-93de-53ed79391e6b service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-unplugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:43:52 user nova-compute[75017]: WARNING nova.compute.manager [req-3195baa4-f6a8-458e-846e-a180832919ee req-e898ae50-e723-460e-93de-53ed79391e6b service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-unplugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state active and task_state rescuing.
Oct 30 09:43:52 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:53 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Instance destroyed successfully.
Oct 30 09:43:53 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Attempting a stable device rescue
Oct 30 09:43:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75017) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 09:43:53 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Instance directory exists: not creating {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 09:43:53 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Creating image(s)
Oct 30 09:43:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "/opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "/opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "/opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:53 user nova-compute[75017]: DEBUG nova.objects.instance [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'trusted_certs' on Instance uuid a886d30f-1e63-472c-b740-677cbd44d565 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:43:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "8e1ecec68478061cdafff799670f2cf1d239e3d2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "8e1ecec68478061cdafff799670f2cf1d239e3d2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2.part --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.images [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] 74f5bee1-4385-4554-a345-0d856fe4d939 was qcow2, converting to raw {{(pid=75017) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.privsep.utils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75017) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2.part /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2.converted {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2.part /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2.converted" returned: 0 in 0.216s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2.converted --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-94748a27-03ae-467b-bd0a-aec70dc520ea req-6224ded9-3915-420f-9ff3-0f3707f0e8e4 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-94748a27-03ae-467b-bd0a-aec70dc520ea req-6224ded9-3915-420f-9ff3-0f3707f0e8e4 service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-94748a27-03ae-467b-bd0a-aec70dc520ea req-6224ded9-3915-420f-9ff3-0f3707f0e8e4 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-94748a27-03ae-467b-bd0a-aec70dc520ea req-6224ded9-3915-420f-9ff3-0f3707f0e8e4 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-94748a27-03ae-467b-bd0a-aec70dc520ea req-6224ded9-3915-420f-9ff3-0f3707f0e8e4 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:43:54 user nova-compute[75017]: WARNING nova.compute.manager [req-94748a27-03ae-467b-bd0a-aec70dc520ea req-6224ded9-3915-420f-9ff3-0f3707f0e8e4 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state active and task_state rescuing.
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "8e1ecec68478061cdafff799670f2cf1d239e3d2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.534s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "8e1ecec68478061cdafff799670f2cf1d239e3d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "8e1ecec68478061cdafff799670f2cf1d239e3d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2 --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2,backing_fmt=raw /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2,backing_fmt=raw /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue" returned: 0 in 0.049s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "8e1ecec68478061cdafff799670f2cf1d239e3d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.objects.instance [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'migration_context' on Instance uuid a886d30f-1e63-472c-b740-677cbd44d565 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.objects.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<a886d30f-1e63-472c-b740-677cbd44d565> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Start _get_guest_xml network_info=[{"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "vif_mac": "fa:16:3e:e5:42:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '74f5bee1-4385-4554-a345-0d856fe4d939', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsNltWSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a886d30f-1e63-472c-b740-677cbd44d565', 'attached_at': '', 'detached_at': '', 'volume_id': '4d026977-3f87-46bc-952a-96b06135fbda', 'serial': '4d026977-3f87-46bc-952a-96b06135fbda'}, 'disk_bus': 'virtio', 'attachment_id': 'e507943d-eaa5-449a-b68a-f5ba69d49f99', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.objects.instance [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'resources' on Instance uuid a886d30f-1e63-472c-b740-677cbd44d565 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.objects.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<a886d30f-1e63-472c-b740-677cbd44d565> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.objects.instance [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'numa_topology' on Instance uuid a886d30f-1e63-472c-b740-677cbd44d565 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.objects.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<a886d30f-1e63-472c-b740-677cbd44d565> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:43:54 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:43:54 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.objects.instance [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'vcpu_model' on Instance uuid a886d30f-1e63-472c-b740-677cbd44d565 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:43:54 user nova-compute[75017]: DEBUG nova.objects.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<a886d30f-1e63-472c-b740-677cbd44d565> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsNltWSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:43:55 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:43:55 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:43:55 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f960cec6-ac1e-4f6b-9e20-e2d846524b2e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LsNltWSg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 30 09:43:55 user nova-compute[75017]: node.name = iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda
Oct 30 09:43:55 user nova-compute[75017]: node.tpgt = -1
Oct 30 09:43:55 user nova-compute[75017]: node.startup = automatic
Oct 30 09:43:55 user nova-compute[75017]: node.leading_login = No
Oct 30 09:43:55 user nova-compute[75017]: iface.iscsi_ifacename = default
Oct 30 09:43:55 user nova-compute[75017]: iface.net_ifacename = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.ipaddress = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.prefix_len = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.hwaddress = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.transport_name = tcp
Oct 30 09:43:55 user nova-compute[75017]: iface.initiatorname = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.state = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.vlan_id = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.vlan_priority = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.vlan_state = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.iface_num = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.mtu = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.port = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.bootproto = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.subnet_mask = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.gateway = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.dhcp_alt_client_id_state = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.dhcp_alt_client_id = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.dhcp_dns = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.dhcp_learn_iqn = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.dhcp_req_vendor_id_state = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.dhcp_vendor_id_state = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.dhcp_vendor_id = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.dhcp_slp_da = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.fragmentation = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.gratuitous_arp = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.incoming_forwarding = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.tos_state = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.tos = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.ttl = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.delayed_ack = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.tcp_nagle = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.tcp_wsf_state = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.tcp_wsf = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.tcp_timer_scale = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.tcp_timestamp = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.redirect = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.def_task_mgmt_timeout = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.header_digest = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.data_digest = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.immediate_data = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.initial_r2t = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.data_seq_inorder = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.data_pdu_inorder = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.erl = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.max_receive_data_len = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.first_burst_len = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.max_outstanding_r2t = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.max_burst_len = 0
Oct 30 09:43:55 user nova-compute[75017]: iface.chap_auth = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.bidi_chap = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.strict_login_compliance = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.discovery_auth = <empty>
Oct 30 09:43:55 user nova-compute[75017]: iface.discovery_logout = <empty>
Oct 30 09:43:55 user nova-compute[75017]: node.discovery_address = <empty>
Oct 30 09:43:55 user nova-compute[75017]: node.discovery_port = 0
Oct 30 09:43:55 user nova-compute[75017]: node.discovery_type = static
Oct 30 09:43:55 user nova-compute[75017]: node.session.initial_cmdsn = 0
Oct 30 09:43:55 user nova-compute[75017]: node.session.initial_login_retry_max = 8
Oct 30 09:43:55 user nova-compute[75017]: node.session.xmit_thread_priority = -20
Oct 30 09:43:55 user nova-compute[75017]: node.session.cmds_max = 128
Oct 30 09:43:55 user nova-compute[75017]: node.session.queue_depth = 32
Oct 30 09:43:55 user nova-compute[75017]: node.session.nr_sessions = 1
Oct 30 09:43:55 user nova-compute[75017]: node.session.auth.authmethod = CHAP
Oct 30 09:43:55 user nova-compute[75017]: node.session.auth.username = LsNltWSg
Oct 30 09:43:55 user nova-compute[75017]: node.session.auth.password = ***
Oct 30 09:43:55 user nova-compute[75017]: node.session.auth.username_in = <empty>
Oct 30 09:43:55 user nova-compute[75017]: node.session.auth.password_in = <empty>
Oct 30 09:43:55 user nova-compute[75017]: node.session.auth.chap_algs = MD5
Oct 30 09:43:55 user nova-compute[75017]: node.session.timeo.replacement_timeout = 120
Oct 30 09:43:55 user nova-compute[75017]: node.session.err_timeo.abort_timeout = 15
Oct 30 09:43:55 user nova-compute[75017]: node.session.err_timeo.lu_reset_timeout = 30
Oct 30 09:43:55 user nova-compute[75017]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 30 09:43:55 user nova-compute[75017]: node.session.err_timeo.host_reset_timeout = 60
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.FastAbort = Yes
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.InitialR2T = No
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.ImmediateData = Yes
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.FirstBurstLength = 262144
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.MaxBurstLength = 16776192
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.DefaultTime2Retain = 0
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.DefaultTime2Wait = 2
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.MaxConnections = 1
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 30 09:43:55 user nova-compute[75017]: node.session.iscsi.ERL = 0
Oct 30 09:43:55 user nova-compute[75017]: node.session.scan = manual
Oct 30 09:43:55 user nova-compute[75017]: node.session.reopen_max = 0
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].address = 172.16.0.220
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].port = 3260
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].startup = manual
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].tcp.window_size = 524288
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].tcp.type_of_service = 0
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].timeo.logout_timeout = 15
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].timeo.login_timeout = 15
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].timeo.auth_timeout = 45
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].timeo.noop_out_interval = 5
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].timeo.noop_out_timeout = 5
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].iscsi.HeaderDigest = None
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].iscsi.DataDigest = None
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].iscsi.IFMarker = No
Oct 30 09:43:55 user nova-compute[75017]: node.conn[0].iscsi.OFMarker = No
Oct 30 09:43:55 user nova-compute[75017]: # END RECORD
Oct 30 09:43:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79178e1-3181-4a7f-bab3-3bb8be214970]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f400e6-4e7e-4ce1-b583-6207bf100cf6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsNltWSg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsNltWSg" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f462e8-97a0-4907-a626-4ea05812c2de]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LsNltWSg'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3440d1d-744c-4160-8253-998845a299f0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[837bc743-5bcb-47db-939c-3a08321567fe]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:43:55 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:43:55 user nova-compute[75017]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 (non-flash)
Oct 30 09:43:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:43:55 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:43:55 user nova-compute[75017]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 (non-flash)
Oct 30 09:43:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.164s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] HCTL ('33', '0', '0', 0) found on session 45 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e8ee8f-a8d6-4b67-bce8-62cf7ce03720]: (4, ('0 0 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Searching for a device in session 45 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsNltWSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '23362303665323037', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362303665323037', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:42:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-20992873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-20992873',id=46,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:42:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-h516kdcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:42:46Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=a886d30f-1e63-472c-b740-677cbd44d565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "vif_mac": "fa:16:3e:e5:42:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "vif_mac": "fa:16:3e:e5:42:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:42:70,bridge_name='br-int',has_traffic_filtering=True,id=87c0edf5-b2c8-469f-91b9-c73a1dde04a4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c0edf5-b2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.objects.instance [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'pci_devices' on Instance uuid a886d30f-1e63-472c-b740-677cbd44d565 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.objects.base [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Object Instance<a886d30f-1e63-472c-b740-677cbd44d565> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:43:55 user nova-compute[75017]:   <uuid>a886d30f-1e63-472c-b740-677cbd44d565</uuid>
Oct 30 09:43:55 user nova-compute[75017]:   <name>instance-0000002e</name>
Oct 30 09:43:55 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:43:55 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:43:55 user nova-compute[75017]:   <metadata>
Oct 30 09:43:55 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:43:55 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:43:55 user nova-compute[75017]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-20992873</nova:name>
Oct 30 09:43:55 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:43:54</nova:creationTime>
Oct 30 09:43:55 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:43:55 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:43:55 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:43:55 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:43:55 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:43:55 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:43:55 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:43:55 user nova-compute[75017]:       <nova:owner>
Oct 30 09:43:55 user nova-compute[75017]:         <nova:user uuid="d734d26551bc41a585d443a24fac0cd8">tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member</nova:user>
Oct 30 09:43:55 user nova-compute[75017]:         <nova:project uuid="76ba6409f82447ba9d0f4f56eef88b1d">tempest-ServerBootFromVolumeStableRescueTest-1506388181</nova:project>
Oct 30 09:43:55 user nova-compute[75017]:       </nova:owner>
Oct 30 09:43:55 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:43:55 user nova-compute[75017]:       <nova:ports>
Oct 30 09:43:55 user nova-compute[75017]:         <nova:port uuid="87c0edf5-b2c8-469f-91b9-c73a1dde04a4">
Oct 30 09:43:55 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 09:43:55 user nova-compute[75017]:         </nova:port>
Oct 30 09:43:55 user nova-compute[75017]:       </nova:ports>
Oct 30 09:43:55 user nova-compute[75017]:     </nova:instance>
Oct 30 09:43:55 user nova-compute[75017]:   </metadata>
Oct 30 09:43:55 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:43:55 user nova-compute[75017]:     <system>
Oct 30 09:43:55 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:43:55 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:43:55 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:43:55 user nova-compute[75017]:       <entry name="serial">a886d30f-1e63-472c-b740-677cbd44d565</entry>
Oct 30 09:43:55 user nova-compute[75017]:       <entry name="uuid">a886d30f-1e63-472c-b740-677cbd44d565</entry>
Oct 30 09:43:55 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:43:55 user nova-compute[75017]:     </system>
Oct 30 09:43:55 user nova-compute[75017]:   </sysinfo>
Oct 30 09:43:55 user nova-compute[75017]:   <os>
Oct 30 09:43:55 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:43:55 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:43:55 user nova-compute[75017]:   </os>
Oct 30 09:43:55 user nova-compute[75017]:   <features>
Oct 30 09:43:55 user nova-compute[75017]:     <acpi/>
Oct 30 09:43:55 user nova-compute[75017]:     <apic/>
Oct 30 09:43:55 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:43:55 user nova-compute[75017]:   </features>
Oct 30 09:43:55 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:43:55 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:43:55 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:43:55 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:43:55 user nova-compute[75017]:   </clock>
Oct 30 09:43:55 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:43:55 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:43:55 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:43:55 user nova-compute[75017]:   </cpu>
Oct 30 09:43:55 user nova-compute[75017]:   <devices>
Oct 30 09:43:55 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:43:55 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:43:55 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:43:55 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:43:55 user nova-compute[75017]:       <serial>4d026977-3f87-46bc-952a-96b06135fbda</serial>
Oct 30 09:43:55 user nova-compute[75017]:     </disk>
Oct 30 09:43:55 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:43:55 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:43:55 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue"/>
Oct 30 09:43:55 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:43:55 user nova-compute[75017]:       <boot order="1"/>
Oct 30 09:43:55 user nova-compute[75017]:     </disk>
Oct 30 09:43:55 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:43:55 user nova-compute[75017]:       <mac address="fa:16:3e:e5:42:70"/>
Oct 30 09:43:55 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:43:55 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:43:55 user nova-compute[75017]:       <target dev="tap87c0edf5-b2"/>
Oct 30 09:43:55 user nova-compute[75017]:     </interface>
Oct 30 09:43:55 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:43:55 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/console.log" append="off"/>
Oct 30 09:43:55 user nova-compute[75017]:     </serial>
Oct 30 09:43:55 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:43:55 user nova-compute[75017]:     <video>
Oct 30 09:43:55 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:43:55 user nova-compute[75017]:     </video>
Oct 30 09:43:55 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:43:55 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:43:55 user nova-compute[75017]:     </rng>
Oct 30 09:43:55 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:43:55 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:43:55 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:43:55 user nova-compute[75017]:     </memballoon>
Oct 30 09:43:55 user nova-compute[75017]:   </devices>
Oct 30 09:43:55 user nova-compute[75017]: </domain>
Oct 30 09:43:55 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:43:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Instance destroyed successfully.
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:43:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] No VIF found with MAC fa:16:3e:e5:42:70, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:43:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-6b751cc2-0a43-4857-b535-ba8b619a2c5f req-96e01db0-0d11-4a52-b8f4-be7ad6062742 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:43:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6b751cc2-0a43-4857-b535-ba8b619a2c5f req-96e01db0-0d11-4a52-b8f4-be7ad6062742 service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6b751cc2-0a43-4857-b535-ba8b619a2c5f req-96e01db0-0d11-4a52-b8f4-be7ad6062742 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6b751cc2-0a43-4857-b535-ba8b619a2c5f req-96e01db0-0d11-4a52-b8f4-be7ad6062742 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-6b751cc2-0a43-4857-b535-ba8b619a2c5f req-96e01db0-0d11-4a52-b8f4-be7ad6062742 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:43:56 user nova-compute[75017]: WARNING nova.compute.manager [req-6b751cc2-0a43-4857-b535-ba8b619a2c5f req-96e01db0-0d11-4a52-b8f4-be7ad6062742 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state active and task_state rescuing.
Oct 30 09:43:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:43:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-11c4982d-fc57-4842-99e5-60dacf98ec74 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:43:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-9c93ca18-c769-40aa-89f0-0b78934e8ef7 req-07c954b5-0d91-4229-9145-3488dea870a7 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:43:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9c93ca18-c769-40aa-89f0-0b78934e8ef7 req-07c954b5-0d91-4229-9145-3488dea870a7 service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:43:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9c93ca18-c769-40aa-89f0-0b78934e8ef7 req-07c954b5-0d91-4229-9145-3488dea870a7 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:43:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9c93ca18-c769-40aa-89f0-0b78934e8ef7 req-07c954b5-0d91-4229-9145-3488dea870a7 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:43:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-9c93ca18-c769-40aa-89f0-0b78934e8ef7 req-07c954b5-0d91-4229-9145-3488dea870a7 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:43:58 user nova-compute[75017]: WARNING nova.compute.manager [req-9c93ca18-c769-40aa-89f0-0b78934e8ef7 req-07c954b5-0d91-4229-9145-3488dea870a7 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state active and task_state rescuing.
Oct 30 09:44:01 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de224282-93e3-4f0e-a748-4e02efb80c5c is timed out.
Oct 30 09:44:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully detached device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the live domain config.
Oct 30 09:44:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKZLTdWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:44:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a07ee5e-f3fc-41c2-9a12-a3e448499219]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:44:01 user nova-compute[75017]: No targets found.
Oct 30 09:44:01 user nova-compute[75017]: iSNS:
Oct 30 09:44:01 user nova-compute[75017]: No targets found.
Oct 30 09:44:01 user nova-compute[75017]: STATIC:
Oct 30 09:44:01 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:44:01 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:44:01 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:44:01 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda
Oct 30 09:44:01 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:44:01 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:44:01 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24
Oct 30 09:44:01 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:44:01 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:44:01 user nova-compute[75017]: FIRMWARE:
Oct 30 09:44:01 user nova-compute[75017]: No targets found.
Oct 30 09:44:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:44:01 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:44:01 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1c1dd-6006-4959-9e07-c2bb1157132c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b76841-0ffd-4e21-8203-917b7c17b91b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:01 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:01 user nova-compute[75017]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 (non-flash)
Oct 30 09:44:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:01 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:01 user nova-compute[75017]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 (non-flash)
Oct 30 09:44:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd7bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cd06db-dded-47eb-b3bb-7e1a74c1291b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[51138463-2128-4d4b-8333-573aec5510a7]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e856b79-cd65-49ed-a4fa-d4995b02c5b6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8520a9-00a3-43f2-8ad3-14e0f6b5fb2b]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0527772-ced5-4d10-b9f1-205a3ae20fc2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd48feda-241e-41e3-a50a-4747af88339a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24, portal: 172.16.0.220,3260]
Oct 30 09:44:01 user nova-compute[75017]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24, portal: 172.16.0.220,3260] successful.
Oct 30 09:44:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f959ad53-542f-4857-b7fd-e3e329ac7f24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c38c389-ea94-461b-8831-f0293267200d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== disconnect_volume: return (324ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:44:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:44:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:03 user nova-compute[75017]: DEBUG nova.objects.instance [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:44:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6fe7c035-3db7-4c7b-ba5a-e18bfb3c11fb tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.184s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:44:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Creating image(s)
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Ensure instance console log exists: /opt/stack/data/nova/instances/13d468ad-69a5-409d-b737-188a4f1a7bda/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Start _get_guest_xml network_info=[{"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQwHPbKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13d468ad-69a5-409d-b737-188a4f1a7bda', 'attached_at': '', 'detached_at': '', 'volume_id': 'd78b4332-e3cc-4093-8c0a-bfc6c735b09c', 'serial': 'd78b4332-e3cc-4093-8c0a-bfc6c735b09c'}, 'disk_bus': 'virtio', 'attachment_id': '605c53ea-3395-4eda-8749-9c6ccaed382c', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:44:05 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:44:05 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQwHPbKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:44:05 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:44:05 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:44:05 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6461ae0-9160-42d9-878f-46122968e9fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:44:05 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8193d473-429b-4157-8dd7-8fdff99b9ad5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c] added
Oct 30 09:44:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84066c8e-9cff-47f5-b848-1e74c3534e46]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aabf1d-5c78-40cb-ad2a-4fba115c5dce]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQwHPbKa {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQwHPbKa" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84953f60-7202-43c9-9ed8-d2106ce3ec1e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EQwHPbKa'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a468e7d-afe3-44dd-8149-4d298ab525f9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eb419f-5a08-4baa-91ed-6e2f280180a6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:06 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:06 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfaf847-9e10-4856-9619-6370d1ac92a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c, portal: 172.16.0.220,3260]
Oct 30 09:44:06 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c, portal: 172.16.0.220,3260] successful.
Oct 30 09:44:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbbe391-b351-476c-a644-be8df4a610e2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ee2f2-3744-447e-94c3-26073b3bdc51]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:06 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:06 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:06 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:06 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:06 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c6ed9c-6d9c-4edf-a622-e2d2bfe4ae4a]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:44:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQwHPbKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23265653139613637', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265653139613637', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1587446584',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1587446584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1587446584',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIwaZyIobthabPRI2gaNshu/g28y+xIeNUS39Z8+5KMotuzMT1Ro88s/ZfbOFbEwPkea5M8WqXjMIZH5P/hAgV6xpfjKjqcErYiKiLp5GYeEkBSJG9s39Cbcqb70vPYVQ==',key_name='tempest-keypair-1212348368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-b8dri09r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd23876ced14c21a33d3c13100323a3',uuid=13d468ad-69a5-409d-b737-188a4f1a7bda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=1a5e045c-628a-4c84-ba60-dae49f823989,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a5e045c-62') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'pci_devices' on Instance uuid 13d468ad-69a5-409d-b737-188a4f1a7bda {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:44:07 user nova-compute[75017]:   <uuid>13d468ad-69a5-409d-b737-188a4f1a7bda</uuid>
Oct 30 09:44:07 user nova-compute[75017]:   <name>instance-0000002f</name>
Oct 30 09:44:07 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:44:07 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:44:07 user nova-compute[75017]:   <metadata>
Oct 30 09:44:07 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:44:07 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:44:07 user nova-compute[75017]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1587446584</nova:name>
Oct 30 09:44:07 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:44:05</nova:creationTime>
Oct 30 09:44:07 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:44:07 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:44:07 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:44:07 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:44:07 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:44:07 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:44:07 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:44:07 user nova-compute[75017]:       <nova:owner>
Oct 30 09:44:07 user nova-compute[75017]:         <nova:user uuid="5cd23876ced14c21a33d3c13100323a3">tempest-TestVolumeBootPattern-2136848934-project-member</nova:user>
Oct 30 09:44:07 user nova-compute[75017]:         <nova:project uuid="7428fb3055ac4e39b8e00760816b5bb4">tempest-TestVolumeBootPattern-2136848934</nova:project>
Oct 30 09:44:07 user nova-compute[75017]:       </nova:owner>
Oct 30 09:44:07 user nova-compute[75017]:       <nova:ports>
Oct 30 09:44:07 user nova-compute[75017]:         <nova:port uuid="1a5e045c-628a-4c84-ba60-dae49f823989">
Oct 30 09:44:07 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 09:44:07 user nova-compute[75017]:         </nova:port>
Oct 30 09:44:07 user nova-compute[75017]:       </nova:ports>
Oct 30 09:44:07 user nova-compute[75017]:     </nova:instance>
Oct 30 09:44:07 user nova-compute[75017]:   </metadata>
Oct 30 09:44:07 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:44:07 user nova-compute[75017]:     <system>
Oct 30 09:44:07 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:44:07 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:44:07 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:44:07 user nova-compute[75017]:       <entry name="serial">13d468ad-69a5-409d-b737-188a4f1a7bda</entry>
Oct 30 09:44:07 user nova-compute[75017]:       <entry name="uuid">13d468ad-69a5-409d-b737-188a4f1a7bda</entry>
Oct 30 09:44:07 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:44:07 user nova-compute[75017]:     </system>
Oct 30 09:44:07 user nova-compute[75017]:   </sysinfo>
Oct 30 09:44:07 user nova-compute[75017]:   <os>
Oct 30 09:44:07 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:44:07 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:44:07 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:44:07 user nova-compute[75017]:   </os>
Oct 30 09:44:07 user nova-compute[75017]:   <features>
Oct 30 09:44:07 user nova-compute[75017]:     <acpi/>
Oct 30 09:44:07 user nova-compute[75017]:     <apic/>
Oct 30 09:44:07 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:44:07 user nova-compute[75017]:   </features>
Oct 30 09:44:07 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:44:07 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:44:07 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:44:07 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:44:07 user nova-compute[75017]:   </clock>
Oct 30 09:44:07 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:44:07 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:44:07 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:44:07 user nova-compute[75017]:   </cpu>
Oct 30 09:44:07 user nova-compute[75017]:   <devices>
Oct 30 09:44:07 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:44:07 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:44:07 user nova-compute[75017]:       <source dev="/dev/sdc"/>
Oct 30 09:44:07 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:44:07 user nova-compute[75017]:       <serial>d78b4332-e3cc-4093-8c0a-bfc6c735b09c</serial>
Oct 30 09:44:07 user nova-compute[75017]:     </disk>
Oct 30 09:44:07 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:44:07 user nova-compute[75017]:       <mac address="fa:16:3e:9d:89:6d"/>
Oct 30 09:44:07 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:44:07 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:44:07 user nova-compute[75017]:       <target dev="tap1a5e045c-62"/>
Oct 30 09:44:07 user nova-compute[75017]:     </interface>
Oct 30 09:44:07 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:44:07 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/13d468ad-69a5-409d-b737-188a4f1a7bda/console.log" append="off"/>
Oct 30 09:44:07 user nova-compute[75017]:     </serial>
Oct 30 09:44:07 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:44:07 user nova-compute[75017]:     <video>
Oct 30 09:44:07 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:44:07 user nova-compute[75017]:     </video>
Oct 30 09:44:07 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:44:07 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:44:07 user nova-compute[75017]:     </rng>
Oct 30 09:44:07 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:44:07 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:44:07 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:44:07 user nova-compute[75017]:     </memballoon>
Oct 30 09:44:07 user nova-compute[75017]:   </devices>
Oct 30 09:44:07 user nova-compute[75017]: </domain>
Oct 30 09:44:07 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1587446584',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1587446584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1587446584',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIwaZyIobthabPRI2gaNshu/g28y+xIeNUS39Z8+5KMotuzMT1Ro88s/ZfbOFbEwPkea5M8WqXjMIZH5P/hAgV6xpfjKjqcErYiKiLp5GYeEkBSJG9s39Cbcqb70vPYVQ==',key_name='tempest-keypair-1212348368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-b8dri09r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd23876ced14c21a33d3c13100323a3',uuid=13d468ad-69a5-409d-b737-188a4f1a7bda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=1a5e045c-628a-4c84-ba60-dae49f823989,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a5e045c-62') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_vif [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=1a5e045c-628a-4c84-ba60-dae49f823989,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a5e045c-62') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3b3d4a5-f18b-5ac1-8ec8-dc2974915f2d', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a5e045c-62, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a5e045c-62, col_values=(('qos', UUID('2d34efc8-9c07-4332-a00e-c76a035f41f1')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a5e045c-62, col_values=(('external_ids', {'iface-id': '1a5e045c-628a-4c84-ba60-dae49f823989', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:89:6d', 'vm-uuid': '13d468ad-69a5-409d-b737-188a4f1a7bda'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIhROCfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:44:07 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:44:07 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:44:07 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:07 user nova-compute[75017]: INFO os_vif [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=1a5e045c-628a-4c84-ba60-dae49f823989,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a5e045c-62')
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f347979b-e7a8-4c8f-9772-a830e9e16812]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:44:07 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb93c0ee-d3a6-4229-90d6-0b3387464131]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3] added
Oct 30 09:44:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6f5fa3-636f-4283-bfef-9d9191538800]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No VIF found with MAC fa:16:3e:9d:89:6d, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[449faf51-38cf-4aea-a595-6845b63f930c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIhROCfJ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIhROCfJ" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[396841d4-70a8-41be-9b6b-e7c18341a800]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aIhROCfJ'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a83f4f4-484d-4465-8a34-9a2565cfde99]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91499f9-1541-4295-a578-29da9118e758]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60c7c22-0bc3-4de1-8285-b45118021769]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260]
Oct 30 09:44:07 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260] successful.
Oct 30 09:44:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e966a48-381d-431c-a42e-5bd9234ae4bb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d174582-6cb9-48df-9e65-49fd08d65945]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:44:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:07 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:44:07 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b427845-fada-4a99-bf51-224d1535a0d0]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:44:07 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIhROCfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26131633465303835', 'path': '/dev/sdd'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131633465303835', 'path': '/dev/sdd'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:44:08 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:44:08 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:44:08 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:44:08 user nova-compute[75017]:   <serial>66122ba3-0e62-46b0-b5a3-0c6594ff58b3</serial>
Oct 30 09:44:08 user nova-compute[75017]: </disk>
Oct 30 09:44:08 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-4fc4b654-a1c4-48da-ab0c-58c9cb2d7f1c req-1949ad2d-0157-4176-afef-fc150346b7a6 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received event network-vif-plugged-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4fc4b654-a1c4-48da-ab0c-58c9cb2d7f1c req-1949ad2d-0157-4176-afef-fc150346b7a6 service nova] Acquiring lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4fc4b654-a1c4-48da-ab0c-58c9cb2d7f1c req-1949ad2d-0157-4176-afef-fc150346b7a6 service nova] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4fc4b654-a1c4-48da-ab0c-58c9cb2d7f1c req-1949ad2d-0157-4176-afef-fc150346b7a6 service nova] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:08 user nova-compute[75017]: DEBUG nova.compute.manager [req-4fc4b654-a1c4-48da-ab0c-58c9cb2d7f1c req-1949ad2d-0157-4176-afef-fc150346b7a6 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] No waiting events found dispatching network-vif-plugged-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:44:08 user nova-compute[75017]: WARNING nova.compute.manager [req-4fc4b654-a1c4-48da-ab0c-58c9cb2d7f1c req-1949ad2d-0157-4176-afef-fc150346b7a6 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received unexpected event network-vif-plugged-1a5e045c-628a-4c84-ba60-dae49f823989 for instance with vm_state building and task_state spawning.
Oct 30 09:44:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No VIF found with MAC fa:16:3e:4e:b7:ce, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d25a98f7-e45a-4403-b972-e0dd0eb47a7a tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.453s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c611f655-9743-462c-b578-47976659bd89 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c611f655-9743-462c-b578-47976659bd89 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c611f655-9743-462c-b578-47976659bd89 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c611f655-9743-462c-b578-47976659bd89 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75017) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c611f655-9743-462c-b578-47976659bd89 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG nova.compute.manager [req-bf2d05ec-4995-4295-9e77-c975297b52ed req-9e3f587d-4a0c-4abe-9dc1-85139477b387 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bf2d05ec-4995-4295-9e77-c975297b52ed req-9e3f587d-4a0c-4abe-9dc1-85139477b387 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bf2d05ec-4995-4295-9e77-c975297b52ed req-9e3f587d-4a0c-4abe-9dc1-85139477b387 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bf2d05ec-4995-4295-9e77-c975297b52ed req-9e3f587d-4a0c-4abe-9dc1-85139477b387 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG nova.compute.manager [req-bf2d05ec-4995-4295-9e77-c975297b52ed req-9e3f587d-4a0c-4abe-9dc1-85139477b387 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:44:10 user nova-compute[75017]: WARNING nova.compute.manager [req-bf2d05ec-4995-4295-9e77-c975297b52ed req-9e3f587d-4a0c-4abe-9dc1-85139477b387 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state active and task_state powering-off.
Oct 30 09:44:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:10 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance destroyed successfully.
Oct 30 09:44:10 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c611f655-9743-462c-b578-47976659bd89 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG nova.compute.manager [req-987e894e-c810-4b0e-b03d-c22367c816dd req-cd168479-4e49-4ad2-9159-a3999cd52394 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received event network-vif-plugged-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-987e894e-c810-4b0e-b03d-c22367c816dd req-cd168479-4e49-4ad2-9159-a3999cd52394 service nova] Acquiring lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-987e894e-c810-4b0e-b03d-c22367c816dd req-cd168479-4e49-4ad2-9159-a3999cd52394 service nova] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-987e894e-c810-4b0e-b03d-c22367c816dd req-cd168479-4e49-4ad2-9159-a3999cd52394 service nova] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:10 user nova-compute[75017]: DEBUG nova.compute.manager [req-987e894e-c810-4b0e-b03d-c22367c816dd req-cd168479-4e49-4ad2-9159-a3999cd52394 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] No waiting events found dispatching network-vif-plugged-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:44:10 user nova-compute[75017]: WARNING nova.compute.manager [req-987e894e-c810-4b0e-b03d-c22367c816dd req-cd168479-4e49-4ad2-9159-a3999cd52394 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received unexpected event network-vif-plugged-1a5e045c-628a-4c84-ba60-dae49f823989 for instance with vm_state building and task_state spawning.
Oct 30 09:44:10 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c611f655-9743-462c-b578-47976659bd89 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.033s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:11 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Instance spawned successfully.
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:11 user nova-compute[75017]: INFO nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Took 5.76 seconds to spawn the instance on the hypervisor.
Oct 30 09:44:11 user nova-compute[75017]: DEBUG nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:44:11 user nova-compute[75017]: INFO nova.compute.manager [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Took 26.64 seconds to build instance.
Oct 30 09:44:11 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c9e2172f-b83c-4461-9007-8fb12532569c tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.751s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:44:12 user nova-compute[75017]: WARNING nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state None.
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:44:12 user nova-compute[75017]: WARNING nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state None.
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:44:12 user nova-compute[75017]: WARNING nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state None.
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:44:12 user nova-compute[75017]: WARNING nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state None.
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:12 user nova-compute[75017]: DEBUG nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:44:12 user nova-compute[75017]: WARNING nova.compute.manager [req-93b1e2b4-18d7-46ce-92a0-9c4dc67580cd req-ff8b089f-ee8e-473f-a244-70c33b82ad56 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state None.
Oct 30 09:44:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:32 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:32 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG nova.objects.instance [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:37 user nova-compute[75017]: INFO nova.compute.manager [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attaching volume a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 to /dev/vdb
Oct 30 09:44:37 user nova-compute[75017]: DEBUG os_brick.utils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[161aec2c-5aee-48ac-9cf8-5e3a7fd822fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8979f103-0473-459e-8425-3d1e16e9d928]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4777e884-7eda-44d7-a39d-ae41dc00a1a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faf5bc1-ff6e-46ce-8bd6-9a0fe546f71d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:44:37 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:44:37 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2207a52-1b79-4bd3-9a28-fefba1cabfbd]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG os_brick.utils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:44:37 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating existing volume attachment record: 987ad91b-9e87-4518-9f89-441108e770e6 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:44:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:39 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:44:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:44:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:42 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:44:42 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8325MB free_disk=24.72138214111328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance a886d30f-1e63-472c-b740-677cbd44d565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 13d468ad-69a5-409d-b737-188a4f1a7bda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:44:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:44:43 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:43 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:44:43 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:44:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:44:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:44:43 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:44:43 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid 469c433e-a055-4b0d-a7f1-902cd5b13707 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:44:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updating instance_info_cache with network_info: [{"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:44:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-469c433e-a055-4b0d-a7f1-902cd5b13707" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:44:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:44:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:44:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:44:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:44:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:44:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:44:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:44:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:44:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTcSAvxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:44:57 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:44:57 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:44:57 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb2101-2677-49a1-8032-4368e2b1de72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:44:57 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9271c07-631a-48d1-8bb0-cf0ed2791398]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93] added
Oct 30 09:44:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.115s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d33fba-e4a1-4d26-8566-4279c09acefa]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6514ba-9be4-46e4-8fd7-c935633368b2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTcSAvxJ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTcSAvxJ" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[520be7c2-d888-4cd1-acbb-eb47afa07ebd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTcSAvxJ'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[75abdd66-e7a0-4911-ae38-979a5f5378bb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdecf3a-797d-4eb2-aabf-795f81923487]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf286ce-751f-49b5-b137-ee5c029a4b5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93, portal: 172.16.0.220,3260]
Oct 30 09:44:57 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93, portal: 172.16.0.220,3260] successful.
Oct 30 09:44:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15c1456-efe6-4063-b9c0-727a96573b28]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b35c4c9-a9ab-43c9-bc77-cc212844d4ce]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 (non-flash)
Oct 30 09:44:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[34929c5e-6649-42c8-a355-856b20a64c54]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:44:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:44:58 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:44:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTcSAvxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:44:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:44:58 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26162346535633336', 'path': '/dev/sdf'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:44:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162346535633336', 'path': '/dev/sdf'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:44:58 user nova-compute[75017]: DEBUG nova.objects.instance [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:44:58 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:44:58 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:44:58 user nova-compute[75017]:   <source dev="/dev/sdf"/>
Oct 30 09:44:58 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:44:58 user nova-compute[75017]:   <serial>a56cea3e-e0fa-4e40-9a61-2272bcbfdc93</serial>
Oct 30 09:44:58 user nova-compute[75017]: </disk>
Oct 30 09:44:58 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:44:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:44:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:44:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No VIF found with MAC fa:16:3e:7e:c0:c5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:44:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-93529139-29d8-4ad1-9f17-d9a459ce7c55 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.969s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:45:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:45:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:45:01 user nova-compute[75017]: INFO nova.compute.manager [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Detaching volume a56cea3e-e0fa-4e40-9a61-2272bcbfdc93
Oct 30 09:45:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:01 user nova-compute[75017]: INFO nova.virt.block_device [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attempting to driver detach volume a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 from mountpoint /dev/vdb
Oct 30 09:45:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Attempting to detach device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:45:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:45:01 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:45:01 user nova-compute[75017]:   <source dev="/dev/sdf"/>
Oct 30 09:45:01 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:45:01 user nova-compute[75017]:   <serial>a56cea3e-e0fa-4e40-9a61-2272bcbfdc93</serial>
Oct 30 09:45:01 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:45:01 user nova-compute[75017]: </disk>
Oct 30 09:45:01 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:45:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully detached device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the persistent domain config.
Oct 30 09:45:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:45:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:45:01 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:45:01 user nova-compute[75017]:   <source dev="/dev/sdf"/>
Oct 30 09:45:01 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:45:01 user nova-compute[75017]:   <serial>a56cea3e-e0fa-4e40-9a61-2272bcbfdc93</serial>
Oct 30 09:45:01 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:45:01 user nova-compute[75017]: </disk>
Oct 30 09:45:01 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:45:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:45:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:45:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:22 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de224282-93e3-4f0e-a748-4e02efb80c5c is timed out.
Oct 30 09:45:22 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully detached device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the live domain config.
Oct 30 09:45:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTcSAvxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:45:22 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c07266-b7f4-4376-8525-825b2e9fb94a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:45:22 user nova-compute[75017]: No targets found.
Oct 30 09:45:22 user nova-compute[75017]: iSNS:
Oct 30 09:45:22 user nova-compute[75017]: No targets found.
Oct 30 09:45:22 user nova-compute[75017]: STATIC:
Oct 30 09:45:22 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:45:22 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:45:22 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:45:22 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda
Oct 30 09:45:22 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:45:22 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:45:22 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c
Oct 30 09:45:22 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:45:22 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:45:22 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3
Oct 30 09:45:22 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:45:22 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:45:22 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93
Oct 30 09:45:22 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:45:22 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:45:22 user nova-compute[75017]: FIRMWARE:
Oct 30 09:45:22 user nova-compute[75017]: No targets found.
Oct 30 09:45:22 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:45:22 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:45:22 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93d672a-0534-483d-9c18-b76408bbd5c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f0b81f-cfe1-4bf5-b506-d9f13098ad87]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:45:22 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:45:22 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:45:22 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:45:22 user nova-compute[75017]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 (non-flash)
Oct 30 09:45:22 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:45:22 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:45:22 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:45:22 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:45:22 user nova-compute[75017]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 (non-flash)
Oct 30 09:45:22 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccd78a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93'): ({'sdf'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Removing single pathed devices sdf {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[64957975-1788-439a-935c-3d5595985361]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9599c942-176d-404b-9887-56ebafa3d189]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Flushing IO for device /dev/sdf {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[750908ee-643e-414b-ae20-de7ad0502476]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b72987-425f-42c4-992a-4c65cbf01891]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] SCSI volumes sdf have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d6b09d-8ed0-4b0c-b349-7b7e006be7f5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bdbd46-2e01-44f8-9411-3325d1d2ba01]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93, portal: 172.16.0.220,3260]
Oct 30 09:45:22 user nova-compute[75017]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93, portal: 172.16.0.220,3260] successful.
Oct 30 09:45:22 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56cea3e-e0fa-4e40-9a61-2272bcbfdc93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c0df64-3531-4b36-9a6e-20f67c51b1ff]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== disconnect_volume: return (306ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:45:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:45:23 user nova-compute[75017]: DEBUG nova.objects.instance [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:45:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-6333ede3-8a67-4453-805c-3219e7644ab8 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:45:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:32 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:45:34 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:45:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:45:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:45:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-63b04b69-3e1a-4aeb-885a-f98f01c39a79 req-942a9d2c-689a-45c4-8d88-1b67a1d7e988 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received event network-changed-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:45:36 user nova-compute[75017]: DEBUG nova.compute.manager [req-63b04b69-3e1a-4aeb-885a-f98f01c39a79 req-942a9d2c-689a-45c4-8d88-1b67a1d7e988 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Refreshing instance network info cache due to event network-changed-1a5e045c-628a-4c84-ba60-dae49f823989. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:45:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-63b04b69-3e1a-4aeb-885a-f98f01c39a79 req-942a9d2c-689a-45c4-8d88-1b67a1d7e988 service nova] Acquiring lock "refresh_cache-13d468ad-69a5-409d-b737-188a4f1a7bda" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:45:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-63b04b69-3e1a-4aeb-885a-f98f01c39a79 req-942a9d2c-689a-45c4-8d88-1b67a1d7e988 service nova] Acquired lock "refresh_cache-13d468ad-69a5-409d-b737-188a4f1a7bda" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:45:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-63b04b69-3e1a-4aeb-885a-f98f01c39a79 req-942a9d2c-689a-45c4-8d88-1b67a1d7e988 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Refreshing network info cache for port 1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:45:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-63b04b69-3e1a-4aeb-885a-f98f01c39a79 req-942a9d2c-689a-45c4-8d88-1b67a1d7e988 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Updated VIF entry in instance network info cache for port 1a5e045c-628a-4c84-ba60-dae49f823989. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:45:36 user nova-compute[75017]: DEBUG nova.network.neutron [req-63b04b69-3e1a-4aeb-885a-f98f01c39a79 req-942a9d2c-689a-45c4-8d88-1b67a1d7e988 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Updating instance_info_cache with network_info: [{"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:45:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-63b04b69-3e1a-4aeb-885a-f98f01c39a79 req-942a9d2c-689a-45c4-8d88-1b67a1d7e988 service nova] Releasing lock "refresh_cache-13d468ad-69a5-409d-b737-188a4f1a7bda" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:45:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:45:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:45:40 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:45:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:45:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:45:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:45:40 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:45:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:45:42 user nova-compute[75017]: INFO nova.compute.manager [None req-f7f56ad9-28e6-4ba5-a69d-12ec871ead26 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Unrescuing
Oct 30 09:45:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7f56ad9-28e6-4ba5-a69d-12ec871ead26 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7f56ad9-28e6-4ba5-a69d-12ec871ead26 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquired lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f7f56ad9-28e6-4ba5-a69d-12ec871ead26 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:45:42 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:45:42 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:45:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8396MB free_disk=24.719947814941406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:45:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance a886d30f-1e63-472c-b740-677cbd44d565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 13d468ad-69a5-409d-b737-188a4f1a7bda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f7f56ad9-28e6-4ba5-a69d-12ec871ead26 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Updating instance_info_cache with network_info: [{"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f7f56ad9-28e6-4ba5-a69d-12ec871ead26 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Releasing lock "refresh_cache-a886d30f-1e63-472c-b740-677cbd44d565" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f7f56ad9-28e6-4ba5-a69d-12ec871ead26 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'flavor' on Instance uuid a886d30f-1e63-472c-b740-677cbd44d565 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-800d0fde-1ebb-4d46-9e8f-2668d942258f req-82a450c4-d6c1-44c3-b28d-f55290a8a5e9 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-unplugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-800d0fde-1ebb-4d46-9e8f-2668d942258f req-82a450c4-d6c1-44c3-b28d-f55290a8a5e9 service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-800d0fde-1ebb-4d46-9e8f-2668d942258f req-82a450c4-d6c1-44c3-b28d-f55290a8a5e9 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-800d0fde-1ebb-4d46-9e8f-2668d942258f req-82a450c4-d6c1-44c3-b28d-f55290a8a5e9 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-800d0fde-1ebb-4d46-9e8f-2668d942258f req-82a450c4-d6c1-44c3-b28d-f55290a8a5e9 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-unplugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:45:43 user nova-compute[75017]: WARNING nova.compute.manager [req-800d0fde-1ebb-4d46-9e8f-2668d942258f req-82a450c4-d6c1-44c3-b28d-f55290a8a5e9 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-unplugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:45:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:44 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Instance destroyed successfully.
Oct 30 09:45:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e053705-1611-4c69-88ee-89bd26b5ac05 req-2c67112e-8d58-4da1-ab26-dd52094ebdac service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e053705-1611-4c69-88ee-89bd26b5ac05 req-2c67112e-8d58-4da1-ab26-dd52094ebdac service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e053705-1611-4c69-88ee-89bd26b5ac05 req-2c67112e-8d58-4da1-ab26-dd52094ebdac service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7e053705-1611-4c69-88ee-89bd26b5ac05 req-2c67112e-8d58-4da1-ab26-dd52094ebdac service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:45:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-7e053705-1611-4c69-88ee-89bd26b5ac05 req-2c67112e-8d58-4da1-ab26-dd52094ebdac service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:45:45 user nova-compute[75017]: WARNING nova.compute.manager [req-7e053705-1611-4c69-88ee-89bd26b5ac05 req-2c67112e-8d58-4da1-ab26-dd52094ebdac service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state rescued and task_state unrescuing.
Oct 30 09:45:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updating instance_info_cache with network_info: [{"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:45:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-5279c2eb-3996-4b46-8925-81a5d7022c5f" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:45:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:45:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f7f56ad9-28e6-4ba5-a69d-12ec871ead26 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:45:47 user nova-compute[75017]: WARNING nova.compute.manager [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state active and task_state None.
Oct 30 09:45:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:45:47 user nova-compute[75017]: DEBUG nova.compute.manager [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:45:47 user nova-compute[75017]: WARNING nova.compute.manager [req-b58b64e3-c350-4308-90e7-38714915d3be req-ae83839c-992e-4131-b68a-b479ff3ca980 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state active and task_state None.
Oct 30 09:45:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "7e991bd7-2730-424d-af01-12401695ff4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "7e991bd7-2730-424d-af01-12401695ff4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:45:50 user nova-compute[75017]: INFO nova.compute.claims [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Claim successful on node user
Oct 30 09:45:50 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:45:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:45:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:45:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:45:50 user nova-compute[75017]: INFO nova.virt.block_device [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Booting with volume snapshot 292af71a-37c4-41a9-abdb-82a23798f20a at /dev/vda
Oct 30 09:45:50 user nova-compute[75017]: DEBUG nova.policy [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd23876ced14c21a33d3c13100323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7428fb3055ac4e39b8e00760816b5bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:45:51 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Successfully created port: 70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:45:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Successfully updated port: 70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "refresh_cache-7e991bd7-2730-424d-af01-12401695ff4d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquired lock "refresh_cache-7e991bd7-2730-424d-af01-12401695ff4d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-ff07e818-060a-417d-9f7b-b556e7dd9e69 req-cd6277c1-7e21-4e4e-9ffa-96b0da764e5d service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received event network-changed-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-ff07e818-060a-417d-9f7b-b556e7dd9e69 req-cd6277c1-7e21-4e4e-9ffa-96b0da764e5d service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Refreshing instance network info cache due to event network-changed-70c89b68-e032-4f89-9294-8f386a26eb27. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ff07e818-060a-417d-9f7b-b556e7dd9e69 req-cd6277c1-7e21-4e4e-9ffa-96b0da764e5d service nova] Acquiring lock "refresh_cache-7e991bd7-2730-424d-af01-12401695ff4d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Updating instance_info_cache with network_info: [{"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Releasing lock "refresh_cache-7e991bd7-2730-424d-af01-12401695ff4d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Instance network_info: |[{"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ff07e818-060a-417d-9f7b-b556e7dd9e69 req-cd6277c1-7e21-4e4e-9ffa-96b0da764e5d service nova] Acquired lock "refresh_cache-7e991bd7-2730-424d-af01-12401695ff4d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:45:52 user nova-compute[75017]: DEBUG nova.network.neutron [req-ff07e818-060a-417d-9f7b-b556e7dd9e69 req-cd6277c1-7e21-4e4e-9ffa-96b0da764e5d service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Refreshing network info cache for port 70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:45:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-ff07e818-060a-417d-9f7b-b556e7dd9e69 req-cd6277c1-7e21-4e4e-9ffa-96b0da764e5d service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Updated VIF entry in instance network info cache for port 70c89b68-e032-4f89-9294-8f386a26eb27. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:45:53 user nova-compute[75017]: DEBUG nova.network.neutron [req-ff07e818-060a-417d-9f7b-b556e7dd9e69 req-cd6277c1-7e21-4e4e-9ffa-96b0da764e5d service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Updating instance_info_cache with network_info: [{"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:45:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ff07e818-060a-417d-9f7b-b556e7dd9e69 req-cd6277c1-7e21-4e4e-9ffa-96b0da764e5d service nova] Releasing lock "refresh_cache-7e991bd7-2730-424d-af01-12401695ff4d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:45:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:45:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:45:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:45:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:45:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:45:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG nova.objects.instance [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:00 user nova-compute[75017]: INFO nova.compute.manager [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attaching volume 16c826dd-49d1-49fb-bb52-f340ce45b065 to /dev/vdb
Oct 30 09:46:00 user nova-compute[75017]: DEBUG os_brick.utils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1110e79-0a34-41f2-8913-d96cc99e5ff1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7ea416-80e9-43a0-a9df-1e73ec21f707]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1441b97c-2362-4b4f-a8d5-1d1e5438781c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[890270f4-35ee-4a36-afc6-49cdd839b132]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquired lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG nova.network.neutron [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'info_cache' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:46:00 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:46:00 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15f79fb-0a65-48f9-8ec5-2b3fad44a1c0]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG os_brick.utils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating existing volume attachment record: cb521a59-dd5a-4a32-ad2b-781dbe7a0f56 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:46:00 user nova-compute[75017]: DEBUG nova.objects.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.network.neutron [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating instance_info_cache with network_info: [{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Releasing lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:46:01 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance destroyed successfully.
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'resources' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.objects.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-344788784',display_name='tempest-AttachVolumeTestJSON-server-344788784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-344788784',id=45,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVTBqkedZ8DJcluIuuSR1Rs15YnzXdFIYJW6MeuRFPLbBpZCGoCobvdV+r75RqCnBFUTK/Ud3FmzSHXRcK299KiuruO2+/ng7MI6WYnIozxCe9mRAg6yA2OJX0E7gzgzg==',key_name='tempest-keypair-1729982551',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-hejj34d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=46c70e09-7d64-4488-b20e-7a8d84ddf0e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_vif [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15693dcb-02, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a70c9e16-e5f7-42a9-adcf-fa7faade93e4) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:01 user nova-compute[75017]: INFO os_vif [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02')
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIhROCfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:46:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4577a8-b10e-4816-a535-4c38074aad77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:46:01 user nova-compute[75017]: No targets found.
Oct 30 09:46:01 user nova-compute[75017]: iSNS:
Oct 30 09:46:01 user nova-compute[75017]: No targets found.
Oct 30 09:46:01 user nova-compute[75017]: STATIC:
Oct 30 09:46:01 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:46:01 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:46:01 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:46:01 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda
Oct 30 09:46:01 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:46:01 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:46:01 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c
Oct 30 09:46:01 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:46:01 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:46:01 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3
Oct 30 09:46:01 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:46:01 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:46:01 user nova-compute[75017]: FIRMWARE:
Oct 30 09:46:01 user nova-compute[75017]: No targets found.
Oct 30 09:46:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:46:01 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:46:01 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8410b483-03c0-4535-bc59-9edf9f5a495e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ed03e-b6bf-458e-91de-8b74963f2f2e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d1cf8a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3'): ({'sdd'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Removing single pathed devices sdd {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d19629-c17a-44fe-8d81-e7c021191cc8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e3251f-186b-4951-8cc4-b9b75fb556d2]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flushing IO for device /dev/sdd {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[10676f69-0821-42d2-a893-7b4fb2e591ed]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc2feed-d1cf-4c61-9aa6-b5c2730a7622]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eb7c13-9b70-404b-8208-9ea48cc9be05]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6283223-dd41-4e6a-9715-f8e5a1591a25]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260]
Oct 30 09:46:01 user nova-compute[75017]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260] successful.
Oct 30 09:46:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd78fa4e-2b6c-48e7-b871-1fd11c240eda]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== disconnect_volume: return (326ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Start _get_guest_xml network_info=[{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIhROCfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '46c70e09-7d64-4488-b20e-7a8d84ddf0e6', 'attached_at': '', 'detached_at': '', 'volume_id': '66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 'serial': '66122ba3-0e62-46b0-b5a3-0c6594ff58b3'}, 'disk_bus': 'virtio', 'attachment_id': 'b300925b-4f5a-4543-98c6-4521b8bf6e54', 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'numa_topology' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.objects.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:46:01 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:46:01 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'vcpu_model' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.objects.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIhROCfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:46:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:46:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:46:01 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8849b04a-dea5-4798-897d-185e04d96ff3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:46:01 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e517af-f540-4b87-8143-7674bfffaa36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3] added
Oct 30 09:46:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.utils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e962b3-0bb8-4792-b808-24942796ba7c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f5b95b-690f-4c0d-801f-19c28c5e56e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eadecd2-024a-43b1-bf3a-db30c34e38e3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIhROCfJ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8536b4-47c1-4a58-9163-3d27e17a2a19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIhROCfJ" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4b8089-e160-4053-bd6a-61c93fdeb105]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aIhROCfJ'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd36f7c-678d-4bdd-9439-9302c3794132]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df95b04-7750-4a5d-b7ce-546f3b6b4356]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4659c6f7-55d8-4800-bff7-37825229f53c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:46:01 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1825ab-825a-4bf4-8432-3aa9ee98428f]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.utils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Updating existing volume attachment record: 01be9201-4db0-4361-954c-5bc7da1123af {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7294626f-dde4-4955-bf38-5464ba72f4de]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:01 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dcf70c-be20-4de8-a5d7-c7d04337b95e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260]
Oct 30 09:46:01 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260] successful.
Oct 30 09:46:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30d7599-98a6-46f1-95c8-e76708255460]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb0274-eceb-4d38-90c6-4dd2bdc622e3]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:02 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:02 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:02 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:02 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:02 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:02 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:02 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:02 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa174f4-3ccb-444f-99cd-50043fe4a97e]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:46:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIhROCfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26131633465303835', 'path': '/dev/sdd'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131633465303835', 'path': '/dev/sdd'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-344788784',display_name='tempest-AttachVolumeTestJSON-server-344788784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-344788784',id=45,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVTBqkedZ8DJcluIuuSR1Rs15YnzXdFIYJW6MeuRFPLbBpZCGoCobvdV+r75RqCnBFUTK/Ud3FmzSHXRcK299KiuruO2+/ng7MI6WYnIozxCe9mRAg6yA2OJX0E7gzgzg==',key_name='tempest-keypair-1729982551',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-hejj34d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=46c70e09-7d64-4488-b20e-7a8d84ddf0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'pci_devices' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.objects.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:46:03 user nova-compute[75017]:   <uuid>46c70e09-7d64-4488-b20e-7a8d84ddf0e6</uuid>
Oct 30 09:46:03 user nova-compute[75017]:   <name>instance-0000002d</name>
Oct 30 09:46:03 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:46:03 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:46:03 user nova-compute[75017]:   <metadata>
Oct 30 09:46:03 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:46:03 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:46:03 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeTestJSON-server-344788784</nova:name>
Oct 30 09:46:03 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:46:01</nova:creationTime>
Oct 30 09:46:03 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:46:03 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:46:03 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:46:03 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:46:03 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:46:03 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:46:03 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:46:03 user nova-compute[75017]:       <nova:owner>
Oct 30 09:46:03 user nova-compute[75017]:         <nova:user uuid="0fda3d7725f8465097f0ef2b1abb1989">tempest-AttachVolumeTestJSON-1415373227-project-member</nova:user>
Oct 30 09:46:03 user nova-compute[75017]:         <nova:project uuid="244a9d4d205d46aa86afe4c739d11557">tempest-AttachVolumeTestJSON-1415373227</nova:project>
Oct 30 09:46:03 user nova-compute[75017]:       </nova:owner>
Oct 30 09:46:03 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:46:03 user nova-compute[75017]:       <nova:ports>
Oct 30 09:46:03 user nova-compute[75017]:         <nova:port uuid="15693dcb-0226-45db-8c67-3a72a18d89b1">
Oct 30 09:46:03 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:46:03 user nova-compute[75017]:         </nova:port>
Oct 30 09:46:03 user nova-compute[75017]:       </nova:ports>
Oct 30 09:46:03 user nova-compute[75017]:     </nova:instance>
Oct 30 09:46:03 user nova-compute[75017]:   </metadata>
Oct 30 09:46:03 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:46:03 user nova-compute[75017]:     <system>
Oct 30 09:46:03 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:46:03 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:46:03 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:46:03 user nova-compute[75017]:       <entry name="serial">46c70e09-7d64-4488-b20e-7a8d84ddf0e6</entry>
Oct 30 09:46:03 user nova-compute[75017]:       <entry name="uuid">46c70e09-7d64-4488-b20e-7a8d84ddf0e6</entry>
Oct 30 09:46:03 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:46:03 user nova-compute[75017]:     </system>
Oct 30 09:46:03 user nova-compute[75017]:   </sysinfo>
Oct 30 09:46:03 user nova-compute[75017]:   <os>
Oct 30 09:46:03 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:46:03 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:46:03 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:46:03 user nova-compute[75017]:   </os>
Oct 30 09:46:03 user nova-compute[75017]:   <features>
Oct 30 09:46:03 user nova-compute[75017]:     <acpi/>
Oct 30 09:46:03 user nova-compute[75017]:     <apic/>
Oct 30 09:46:03 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:46:03 user nova-compute[75017]:   </features>
Oct 30 09:46:03 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:46:03 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:46:03 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:46:03 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:46:03 user nova-compute[75017]:   </clock>
Oct 30 09:46:03 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:46:03 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:46:03 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:46:03 user nova-compute[75017]:   </cpu>
Oct 30 09:46:03 user nova-compute[75017]:   <devices>
Oct 30 09:46:03 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:46:03 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:46:03 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk"/>
Oct 30 09:46:03 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:46:03 user nova-compute[75017]:     </disk>
Oct 30 09:46:03 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:46:03 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:46:03 user nova-compute[75017]:       <source dev="/dev/sdd"/>
Oct 30 09:46:03 user nova-compute[75017]:       <target dev="vdb" bus="virtio"/>
Oct 30 09:46:03 user nova-compute[75017]:       <serial>66122ba3-0e62-46b0-b5a3-0c6594ff58b3</serial>
Oct 30 09:46:03 user nova-compute[75017]:     </disk>
Oct 30 09:46:03 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:46:03 user nova-compute[75017]:       <mac address="fa:16:3e:4e:b7:ce"/>
Oct 30 09:46:03 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:46:03 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:46:03 user nova-compute[75017]:       <target dev="tap15693dcb-02"/>
Oct 30 09:46:03 user nova-compute[75017]:     </interface>
Oct 30 09:46:03 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:46:03 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/console.log" append="off"/>
Oct 30 09:46:03 user nova-compute[75017]:     </serial>
Oct 30 09:46:03 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:46:03 user nova-compute[75017]:     <video>
Oct 30 09:46:03 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:46:03 user nova-compute[75017]:     </video>
Oct 30 09:46:03 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:46:03 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:46:03 user nova-compute[75017]:     </rng>
Oct 30 09:46:03 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:46:03 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:46:03 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:46:03 user nova-compute[75017]:     </memballoon>
Oct 30 09:46:03 user nova-compute[75017]:   </devices>
Oct 30 09:46:03 user nova-compute[75017]: </domain>
Oct 30 09:46:03 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'trusted_certs' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.objects.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Cannot resize image /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.objects.instance [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'migration_context' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.objects.base [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-344788784',display_name='tempest-AttachVolumeTestJSON-server-344788784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-344788784',id=45,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVTBqkedZ8DJcluIuuSR1Rs15YnzXdFIYJW6MeuRFPLbBpZCGoCobvdV+r75RqCnBFUTK/Ud3FmzSHXRcK299KiuruO2+/ng7MI6WYnIozxCe9mRAg6yA2OJX0E7gzgzg==',key_name='tempest-keypair-1729982551',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-hejj34d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=46c70e09-7d64-4488-b20e-7a8d84ddf0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG os_vif [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c2ee34a-0597-58cf-88de-aa053cc03702', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15693dcb-02, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15693dcb-02, col_values=(('qos', UUID('79075d04-390e-4d02-a960-4dcf29bfa6cf')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15693dcb-02, col_values=(('external_ids', {'iface-id': '15693dcb-0226-45db-8c67-3a72a18d89b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:b7:ce', 'vm-uuid': '46c70e09-7d64-4488-b20e-7a8d84ddf0e6'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:03 user nova-compute[75017]: INFO os_vif [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02')
Oct 30 09:46:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-48ce5062-4f5e-44f6-8952-ebdefeddd028 req-3fa7238a-e13d-498e-99a1-335f0611650b service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-48ce5062-4f5e-44f6-8952-ebdefeddd028 req-3fa7238a-e13d-498e-99a1-335f0611650b service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-48ce5062-4f5e-44f6-8952-ebdefeddd028 req-3fa7238a-e13d-498e-99a1-335f0611650b service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-48ce5062-4f5e-44f6-8952-ebdefeddd028 req-3fa7238a-e13d-498e-99a1-335f0611650b service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-48ce5062-4f5e-44f6-8952-ebdefeddd028 req-3fa7238a-e13d-498e-99a1-335f0611650b service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:46:05 user nova-compute[75017]: WARNING nova.compute.manager [req-48ce5062-4f5e-44f6-8952-ebdefeddd028 req-3fa7238a-e13d-498e-99a1-335f0611650b service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state powering-on.
Oct 30 09:46:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:46:07 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance rebooted successfully.
Oct 30 09:46:07 user nova-compute[75017]: DEBUG nova.compute.manager [None req-1087f581-db4a-483e-9b84-ad8f60329101 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:46:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-da1d1e00-9013-415e-9f55-27a828fa9ce2 req-70389a8f-ae36-4417-95b1-4349d5a22198 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:46:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-da1d1e00-9013-415e-9f55-27a828fa9ce2 req-70389a8f-ae36-4417-95b1-4349d5a22198 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-da1d1e00-9013-415e-9f55-27a828fa9ce2 req-70389a8f-ae36-4417-95b1-4349d5a22198 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-da1d1e00-9013-415e-9f55-27a828fa9ce2 req-70389a8f-ae36-4417-95b1-4349d5a22198 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-da1d1e00-9013-415e-9f55-27a828fa9ce2 req-70389a8f-ae36-4417-95b1-4349d5a22198 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:46:07 user nova-compute[75017]: WARNING nova.compute.manager [req-da1d1e00-9013-415e-9f55-27a828fa9ce2 req-70389a8f-ae36-4417-95b1-4349d5a22198 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state powering-on.
Oct 30 09:46:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:13 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:28 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxLoEzJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:46:39 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:46:39 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:46:39 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bc3275-1541-4819-84e3-ee908497e380]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:46:39 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad702a1a-23dc-4ecb-ac04-5ae276b0239b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065] added
Oct 30 09:46:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d99f509-f68b-4074-b98d-754674eda53d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[40278ac4-ceb7-4a97-8679-4fdc8216571e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxLoEzJp {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxLoEzJp" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83cd174-fe71-4991-9f0a-369c57b75409]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bxLoEzJp'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c44b2-8d57-48b8-8976-366331795945]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37d3424-5fef-4f38-92ee-3fc24f7cae5d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:46:39 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Creating image(s)
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Ensure instance console log exists: /opt/stack/data/nova/instances/7e991bd7-2730-424d-af01-12401695ff4d/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Start _get_guest_xml network_info=[{"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-30T09:45:37Z,direct_url=<?>,disk_format='qcow2',id=012fce94-6c21-44ea-a5a3-678c0b43c45e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-11932800',owner='7428fb3055ac4e39b8e00760816b5bb4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-30T09:45:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZxphvDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e991bd7-2730-424d-af01-12401695ff4d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd5e1656-6d21-4602-a899-463794744d1c', 'serial': 'bd5e1656-6d21-4602-a899-463794744d1c'}, 'disk_bus': 'virtio', 'attachment_id': '01be9201-4db0-4361-954c-5bc7da1123af', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:46:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:46:39 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-30T09:45:37Z,direct_url=<?>,disk_format='qcow2',id=012fce94-6c21-44ea-a5a3-678c0b43c45e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-11932800',owner='7428fb3055ac4e39b8e00760816b5bb4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-30T09:45:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZxphvDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:46:39 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1022339c-f347-4412-8054-4da7d560ad7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065, portal: 172.16.0.220,3260]
Oct 30 09:46:39 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065, portal: 172.16.0.220,3260] successful.
Oct 30 09:46:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4194c393-2824-4154-959d-b9e0bfe5a3fc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ec4f42-4d66-4afa-a609-75003728eccd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)
Oct 30 09:46:39 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] HCTL ('37', '-', '-', 0) found on session 51 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad951b2-63f3-4615-a70f-1010b189c201]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:39 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxLoEzJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23732636461636265', 'path': '/dev/sdf'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732636461636265', 'path': '/dev/sdf'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.079s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:46:40 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:46:40 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG nova.objects.instance [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4654c750-4163-4b1e-80d3-1b76df5860f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:46:40 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:46:40 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:46:40 user nova-compute[75017]:   <source dev="/dev/sdf"/>
Oct 30 09:46:40 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:46:40 user nova-compute[75017]:   <serial>16c826dd-49d1-49fb-bb52-f340ce45b065</serial>
Oct 30 09:46:40 user nova-compute[75017]: </disk>
Oct 30 09:46:40 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[95713e4c-deb5-4f0d-abd3-6c7fdb3aff65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c] added
Oct 30 09:46:40 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[095819bc-4eff-4817-b440-bb36f9c88caa]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a69d72e-7989-49fa-9eb0-d156e82c86a2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZxphvDc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZxphvDc" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0063ba-bfb3-454c-9075-6796b15fcf26]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iZxphvDc'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f6a083-66d1-4f0e-87ba-9d1d88888524]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bae030-6bc6-4db7-9947-905106733917]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:40 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:40 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:40 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:40 user nova-compute[75017]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)
Oct 30 09:46:40 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:40 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:40 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:40 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:40 user nova-compute[75017]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)
Oct 30 09:46:40 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:46:40 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a66608d-904e-4bd5-ad12-ba93fcc4fe9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c, portal: 172.16.0.220,3260]
Oct 30 09:46:41 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c, portal: 172.16.0.220,3260] successful.
Oct 30 09:46:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7c459a-28a8-49e8-a1d7-b0c990c11ebf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1458986c-d09d-47f3-87b8-3a3d2847c72a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:46:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)
Oct 30 09:46:41 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:46:41 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] HCTL ('38', '-', '-', 0) found on session 52 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9deda-e77f-4b0b-b487-4b134d31924f]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching for a device in session 52 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZxphvDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] No VIF found with MAC fa:16:3e:7e:c0:c5, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-44be884c-76d0-42e1-9a07-68966d0ce7b6 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.941s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== connect_volume: return (2419ms) {'type': 'block', 'scsi_wwn': '26365353732663531', 'path': '/dev/sdg'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365353732663531', 'path': '/dev/sdg'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1069939648',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1069939648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1069939648',id=48,image_ref='012fce94-6c21-44ea-a5a3-678c0b43c45e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTgA/3kcpLag4JQvk5Q82iHsT44BQwLZibCRkWMxpiS5C20fEDhB3lsicGe3PX3Ht5Rcfua5aAaasR535hou6AsMPgPV0XHiUS/JmH5/Cxz1OVG+BX4+tX9QEqaWuyuCA==',key_name='tempest-keypair-901833419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-nsf6ph1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2136848934',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd23876ced14c21a33d3c13100323a3',uuid=7e991bd7-2730-424d-af01-12401695ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a9:29,bridge_name='br-int',has_traffic_filtering=True,id=70c89b68-e032-4f89-9294-8f386a26eb27,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c89b68-e0') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.objects.instance [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e991bd7-2730-424d-af01-12401695ff4d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:46:42 user nova-compute[75017]:   <uuid>7e991bd7-2730-424d-af01-12401695ff4d</uuid>
Oct 30 09:46:42 user nova-compute[75017]:   <name>instance-00000030</name>
Oct 30 09:46:42 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:46:42 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:46:42 user nova-compute[75017]:   <metadata>
Oct 30 09:46:42 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:46:42 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:46:42 user nova-compute[75017]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1069939648</nova:name>
Oct 30 09:46:42 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:46:39</nova:creationTime>
Oct 30 09:46:42 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:46:42 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:46:42 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:46:42 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:46:42 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:46:42 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:46:42 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:46:42 user nova-compute[75017]:       <nova:owner>
Oct 30 09:46:42 user nova-compute[75017]:         <nova:user uuid="5cd23876ced14c21a33d3c13100323a3">tempest-TestVolumeBootPattern-2136848934-project-member</nova:user>
Oct 30 09:46:42 user nova-compute[75017]:         <nova:project uuid="7428fb3055ac4e39b8e00760816b5bb4">tempest-TestVolumeBootPattern-2136848934</nova:project>
Oct 30 09:46:42 user nova-compute[75017]:       </nova:owner>
Oct 30 09:46:42 user nova-compute[75017]:       <nova:root type="image" uuid="012fce94-6c21-44ea-a5a3-678c0b43c45e"/>
Oct 30 09:46:42 user nova-compute[75017]:       <nova:ports>
Oct 30 09:46:42 user nova-compute[75017]:         <nova:port uuid="70c89b68-e032-4f89-9294-8f386a26eb27">
Oct 30 09:46:42 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 09:46:42 user nova-compute[75017]:         </nova:port>
Oct 30 09:46:42 user nova-compute[75017]:       </nova:ports>
Oct 30 09:46:42 user nova-compute[75017]:     </nova:instance>
Oct 30 09:46:42 user nova-compute[75017]:   </metadata>
Oct 30 09:46:42 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:46:42 user nova-compute[75017]:     <system>
Oct 30 09:46:42 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:46:42 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:46:42 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:46:42 user nova-compute[75017]:       <entry name="serial">7e991bd7-2730-424d-af01-12401695ff4d</entry>
Oct 30 09:46:42 user nova-compute[75017]:       <entry name="uuid">7e991bd7-2730-424d-af01-12401695ff4d</entry>
Oct 30 09:46:42 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:46:42 user nova-compute[75017]:     </system>
Oct 30 09:46:42 user nova-compute[75017]:   </sysinfo>
Oct 30 09:46:42 user nova-compute[75017]:   <os>
Oct 30 09:46:42 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:46:42 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:46:42 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:46:42 user nova-compute[75017]:   </os>
Oct 30 09:46:42 user nova-compute[75017]:   <features>
Oct 30 09:46:42 user nova-compute[75017]:     <acpi/>
Oct 30 09:46:42 user nova-compute[75017]:     <apic/>
Oct 30 09:46:42 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:46:42 user nova-compute[75017]:   </features>
Oct 30 09:46:42 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:46:42 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:46:42 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:46:42 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:46:42 user nova-compute[75017]:   </clock>
Oct 30 09:46:42 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:46:42 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:46:42 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:46:42 user nova-compute[75017]:   </cpu>
Oct 30 09:46:42 user nova-compute[75017]:   <devices>
Oct 30 09:46:42 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:46:42 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:46:42 user nova-compute[75017]:       <source dev="/dev/sdg"/>
Oct 30 09:46:42 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:46:42 user nova-compute[75017]:       <serial>bd5e1656-6d21-4602-a899-463794744d1c</serial>
Oct 30 09:46:42 user nova-compute[75017]:     </disk>
Oct 30 09:46:42 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:46:42 user nova-compute[75017]:       <mac address="fa:16:3e:f6:a9:29"/>
Oct 30 09:46:42 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:46:42 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:46:42 user nova-compute[75017]:       <target dev="tap70c89b68-e0"/>
Oct 30 09:46:42 user nova-compute[75017]:     </interface>
Oct 30 09:46:42 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:46:42 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/7e991bd7-2730-424d-af01-12401695ff4d/console.log" append="off"/>
Oct 30 09:46:42 user nova-compute[75017]:     </serial>
Oct 30 09:46:42 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:46:42 user nova-compute[75017]:     <video>
Oct 30 09:46:42 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:46:42 user nova-compute[75017]:     </video>
Oct 30 09:46:42 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:46:42 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:46:42 user nova-compute[75017]:     </rng>
Oct 30 09:46:42 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:46:42 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:46:42 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:46:42 user nova-compute[75017]:     </memballoon>
Oct 30 09:46:42 user nova-compute[75017]:   </devices>
Oct 30 09:46:42 user nova-compute[75017]: </domain>
Oct 30 09:46:42 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1069939648',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1069939648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1069939648',id=48,image_ref='012fce94-6c21-44ea-a5a3-678c0b43c45e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTgA/3kcpLag4JQvk5Q82iHsT44BQwLZibCRkWMxpiS5C20fEDhB3lsicGe3PX3Ht5Rcfua5aAaasR535hou6AsMPgPV0XHiUS/JmH5/Cxz1OVG+BX4+tX9QEqaWuyuCA==',key_name='tempest-keypair-901833419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-nsf6ph1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2136848934',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd23876ced14c21a33d3c13100323a3',uuid=7e991bd7-2730-424d-af01-12401695ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a9:29,bridge_name='br-int',has_traffic_filtering=True,id=70c89b68-e032-4f89-9294-8f386a26eb27,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c89b68-e0') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG os_vif [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a9:29,bridge_name='br-int',has_traffic_filtering=True,id=70c89b68-e032-4f89-9294-8f386a26eb27,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c89b68-e0') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '060e59ad-6d28-5847-869e-678fc5d6cc1e', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70c89b68-e0, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70c89b68-e0, col_values=(('qos', UUID('db84129a-748c-490d-8ad1-d13c2a9912ce')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70c89b68-e0, col_values=(('external_ids', {'iface-id': '70c89b68-e032-4f89-9294-8f386a26eb27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:a9:29', 'vm-uuid': '7e991bd7-2730-424d-af01-12401695ff4d'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:42 user nova-compute[75017]: INFO os_vif [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a9:29,bridge_name='br-int',has_traffic_filtering=True,id=70c89b68-e032-4f89-9294-8f386a26eb27,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c89b68-e0')
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No VIF found with MAC fa:16:3e:f6:a9:29, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:43 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:46:43 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8193MB free_disk=24.710224151611328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:43 user nova-compute[75017]: INFO nova.compute.manager [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Detaching volume 16c826dd-49d1-49fb-bb52-f340ce45b065
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-76c45b6a-71fe-4003-90e0-2e65193551eb req-336d4085-a85b-4602-beda-8c82ca3f6779 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received event network-vif-plugged-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-76c45b6a-71fe-4003-90e0-2e65193551eb req-336d4085-a85b-4602-beda-8c82ca3f6779 service nova] Acquiring lock "7e991bd7-2730-424d-af01-12401695ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-76c45b6a-71fe-4003-90e0-2e65193551eb req-336d4085-a85b-4602-beda-8c82ca3f6779 service nova] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-76c45b6a-71fe-4003-90e0-2e65193551eb req-336d4085-a85b-4602-beda-8c82ca3f6779 service nova] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.manager [req-76c45b6a-71fe-4003-90e0-2e65193551eb req-336d4085-a85b-4602-beda-8c82ca3f6779 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] No waiting events found dispatching network-vif-plugged-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:46:43 user nova-compute[75017]: WARNING nova.compute.manager [req-76c45b6a-71fe-4003-90e0-2e65193551eb req-336d4085-a85b-4602-beda-8c82ca3f6779 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received unexpected event network-vif-plugged-70c89b68-e032-4f89-9294-8f386a26eb27 for instance with vm_state building and task_state spawning.
Oct 30 09:46:43 user nova-compute[75017]: INFO nova.virt.block_device [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Attempting to driver detach volume 16c826dd-49d1-49fb-bb52-f340ce45b065 from mountpoint /dev/vdb
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Attempting to detach device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:46:43 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:46:43 user nova-compute[75017]:   <source dev="/dev/sdf"/>
Oct 30 09:46:43 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:46:43 user nova-compute[75017]:   <serial>16c826dd-49d1-49fb-bb52-f340ce45b065</serial>
Oct 30 09:46:43 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:46:43 user nova-compute[75017]: </disk>
Oct 30 09:46:43 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:46:43 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully detached device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the persistent domain config.
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:46:43 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:46:43 user nova-compute[75017]:   <source dev="/dev/sdf"/>
Oct 30 09:46:43 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:46:43 user nova-compute[75017]:   <serial>16c826dd-49d1-49fb-bb52-f340ce45b065</serial>
Oct 30 09:46:43 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:46:43 user nova-compute[75017]: </disk>
Oct 30 09:46:43 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance a886d30f-1e63-472c-b740-677cbd44d565 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 13d468ad-69a5-409d-b737-188a4f1a7bda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7e991bd7-2730-424d-af01-12401695ff4d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:44 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:46:44 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:46:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:46:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:44 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:46:45 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Instance spawned successfully.
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Updating instance_info_cache with network_info: [{"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-4b861e8e-57b4-42f3-9475-3a6ee5114e8b req-7fba3270-33e6-4300-8ed3-9d3322fac11e service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received event network-vif-plugged-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4b861e8e-57b4-42f3-9475-3a6ee5114e8b req-7fba3270-33e6-4300-8ed3-9d3322fac11e service nova] Acquiring lock "7e991bd7-2730-424d-af01-12401695ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4b861e8e-57b4-42f3-9475-3a6ee5114e8b req-7fba3270-33e6-4300-8ed3-9d3322fac11e service nova] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4b861e8e-57b4-42f3-9475-3a6ee5114e8b req-7fba3270-33e6-4300-8ed3-9d3322fac11e service nova] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.compute.manager [req-4b861e8e-57b4-42f3-9475-3a6ee5114e8b req-7fba3270-33e6-4300-8ed3-9d3322fac11e service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] No waiting events found dispatching network-vif-plugged-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:46:45 user nova-compute[75017]: WARNING nova.compute.manager [req-4b861e8e-57b4-42f3-9475-3a6ee5114e8b req-7fba3270-33e6-4300-8ed3-9d3322fac11e service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received unexpected event network-vif-plugged-70c89b68-e032-4f89-9294-8f386a26eb27 for instance with vm_state building and task_state spawning.
Oct 30 09:46:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-eab947f6-fbac-4685-adc7-722206413b8a" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:46:45 user nova-compute[75017]: INFO nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Took 6.29 seconds to spawn the instance on the hypervisor.
Oct 30 09:46:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:46:46 user nova-compute[75017]: INFO nova.compute.manager [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Took 55.83 seconds to build instance.
Oct 30 09:46:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e7cb12ac-2a42-4484-b568-210ce9360f08 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "7e991bd7-2730-424d-af01-12401695ff4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 55.962s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:46:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:46:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:46:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:46:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:46:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:53 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:46:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:46:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:46:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:46:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:46:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:46:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:04 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de224282-93e3-4f0e-a748-4e02efb80c5c is timed out.
Oct 30 09:47:04 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully detached device vdb from instance de224282-93e3-4f0e-a748-4e02efb80c5c from the live domain config.
Oct 30 09:47:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxLoEzJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:47:04 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae056860-423f-47a1-95c1-5ba005569e1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:47:04 user nova-compute[75017]: No targets found.
Oct 30 09:47:04 user nova-compute[75017]: iSNS:
Oct 30 09:47:04 user nova-compute[75017]: No targets found.
Oct 30 09:47:04 user nova-compute[75017]: STATIC:
Oct 30 09:47:04 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:47:04 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:04 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:04 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c
Oct 30 09:47:04 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:04 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:04 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda
Oct 30 09:47:04 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:04 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:04 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c
Oct 30 09:47:04 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:04 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:04 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3
Oct 30 09:47:04 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:04 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:04 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065
Oct 30 09:47:04 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:04 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:04 user nova-compute[75017]: FIRMWARE:
Oct 30 09:47:04 user nova-compute[75017]: No targets found.
Oct 30 09:47:04 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:47:04 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:47:04 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e6c444-dfbd-43f9-9735-cfa14e38b1d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7000dde8-7018-4946-90fc-7a3923106bdc]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:47:04 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 (non-flash)
Oct 30 09:47:04 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:47:04 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccc71360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065'): ({'sdf'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Removing single pathed devices sdf {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dba8e93-fd83-4975-a59c-7342d1c90f6f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc5f0fd-1562-42f8-9998-4a1f0ce1d7eb]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Flushing IO for device /dev/sdf {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc876774-0356-4436-a1ce-cbaaef4cafa3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba69200-1fac-440f-a0f2-b2120e82f5de]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] SCSI volumes sdf have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[293631ee-146a-4643-96f4-8e711ba41ad9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0f3c31-b797-4a9f-be55-9b615a79336a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065, portal: 172.16.0.220,3260]
Oct 30 09:47:04 user nova-compute[75017]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065, portal: 172.16.0.220,3260] successful.
Oct 30 09:47:04 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c826dd-49d1-49fb-bb52-f340ce45b065 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b3556b-80ce-416a-a25d-92967ca8cf87]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] <== disconnect_volume: return (336ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:47:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:47:05 user nova-compute[75017]: DEBUG nova.objects.instance [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'flavor' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:47:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3e81d61f-6f18-49b4-8dd6-b72c1c5273b7 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.851s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:47:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:47:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:47:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:47:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:47:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "a886d30f-1e63-472c-b740-677cbd44d565" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:47:33 user nova-compute[75017]: INFO nova.compute.manager [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Terminating instance
Oct 30 09:47:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-efe2f013-eb66-4847-af0d-8071d8e6a2d4 req-92016c80-f3de-49c6-b41d-c95200555ea9 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-unplugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-efe2f013-eb66-4847-af0d-8071d8e6a2d4 req-92016c80-f3de-49c6-b41d-c95200555ea9 service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-efe2f013-eb66-4847-af0d-8071d8e6a2d4 req-92016c80-f3de-49c6-b41d-c95200555ea9 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-efe2f013-eb66-4847-af0d-8071d8e6a2d4 req-92016c80-f3de-49c6-b41d-c95200555ea9 service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-efe2f013-eb66-4847-af0d-8071d8e6a2d4 req-92016c80-f3de-49c6-b41d-c95200555ea9 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-unplugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-efe2f013-eb66-4847-af0d-8071d8e6a2d4 req-92016c80-f3de-49c6-b41d-c95200555ea9 service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-unplugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Instance destroyed successfully.
Oct 30 09:47:34 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'resources' on Instance uuid a886d30f-1e63-472c-b740-677cbd44d565 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:42:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-20992873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-20992873',id=46,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:43:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-h516kdcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:45:48Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=a886d30f-1e63-472c-b740-677cbd44d565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "address": "fa:16:3e:e5:42:70", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c0edf5-b2", "ovs_interfaceid": "87c0edf5-b2c8-469f-91b9-c73a1dde04a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:42:70,bridge_name='br-int',has_traffic_filtering=True,id=87c0edf5-b2c8-469f-91b9-c73a1dde04a4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c0edf5-b2') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_vif [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:42:70,bridge_name='br-int',has_traffic_filtering=True,id=87c0edf5-b2c8-469f-91b9-c73a1dde04a4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c0edf5-b2') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87c0edf5-b2, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cfe2d24-07f5-40f5-8f08-88cf7c0088f6) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:47:34 user nova-compute[75017]: INFO os_vif [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:42:70,bridge_name='br-int',has_traffic_filtering=True,id=87c0edf5-b2c8-469f-91b9-c73a1dde04a4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c0edf5-b2')
Oct 30 09:47:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsNltWSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:47:34 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7493578a-a47c-4735-97de-97b1125e9b14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:47:34 user nova-compute[75017]: No targets found.
Oct 30 09:47:34 user nova-compute[75017]: iSNS:
Oct 30 09:47:34 user nova-compute[75017]: No targets found.
Oct 30 09:47:34 user nova-compute[75017]: STATIC:
Oct 30 09:47:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:47:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c
Oct 30 09:47:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda
Oct 30 09:47:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c
Oct 30 09:47:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:34 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3
Oct 30 09:47:34 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:47:34 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:47:34 user nova-compute[75017]: FIRMWARE:
Oct 30 09:47:34 user nova-compute[75017]: No targets found.
Oct 30 09:47:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:47:34 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:47:34 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[06966c87-f7cf-4ccb-a3eb-adc8b5654ce5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[306334d7-a4f5-47d3-9205-c06daedfcc4b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:47:34 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:47:34 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:47:34 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:47:34 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:47:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:47:34 user nova-compute[75017]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda (non-flash)
Oct 30 09:47:34 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:47:34 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:47:34 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:47:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf04d3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5de3c13-7f90-4109-a41a-530507c7332b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32c449e-63c9-480e-8db1-7a788d0231e9]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[42180706-950e-4c4b-a810-75b4adca084e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3919dd-a9df-4c49-ac7e-db181df0f2d8]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adc25f4-6bfc-49b1-9e1d-912d1782cacb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5bc2fa-bd9e-4db0-b35f-cdf6eaf64d56]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda, portal: 172.16.0.220,3260]
Oct 30 09:47:34 user nova-compute[75017]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda, portal: 172.16.0.220,3260] successful.
Oct 30 09:47:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d026977-3f87-46bc-952a-96b06135fbda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ad8f22-a3a7-4a1b-ac60-6dc81c911d31]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] <== disconnect_volume: return (330ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:47:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Deleting instance files /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565_del
Oct 30 09:47:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Deletion of /opt/stack/data/nova/instances/a886d30f-1e63-472c-b740-677cbd44d565_del complete
Oct 30 09:47:34 user nova-compute[75017]: INFO nova.compute.manager [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 30 09:47:34 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: a886d30f-1e63-472c-b740-677cbd44d565] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:47:34 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:47:34 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Took 0.51 seconds to deallocate network for instance.
Oct 30 09:47:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-1615bc56-2d92-4a60-be5d-39b738fcb12b req-68ce3322-7c9a-4c79-970e-27e573945cff service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:47:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1615bc56-2d92-4a60-be5d-39b738fcb12b req-68ce3322-7c9a-4c79-970e-27e573945cff service nova] Acquiring lock "a886d30f-1e63-472c-b740-677cbd44d565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:47:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1615bc56-2d92-4a60-be5d-39b738fcb12b req-68ce3322-7c9a-4c79-970e-27e573945cff service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:47:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1615bc56-2d92-4a60-be5d-39b738fcb12b req-68ce3322-7c9a-4c79-970e-27e573945cff service nova] Lock "a886d30f-1e63-472c-b740-677cbd44d565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:47:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-1615bc56-2d92-4a60-be5d-39b738fcb12b req-68ce3322-7c9a-4c79-970e-27e573945cff service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] No waiting events found dispatching network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:47:35 user nova-compute[75017]: WARNING nova.compute.manager [req-1615bc56-2d92-4a60-be5d-39b738fcb12b req-68ce3322-7c9a-4c79-970e-27e573945cff service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received unexpected event network-vif-plugged-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 for instance with vm_state active and task_state deleting.
Oct 30 09:47:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-1615bc56-2d92-4a60-be5d-39b738fcb12b req-68ce3322-7c9a-4c79-970e-27e573945cff service nova] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Received event network-vif-deleted-87c0edf5-b2c8-469f-91b9-c73a1dde04a4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:47:35 user nova-compute[75017]: INFO nova.compute.manager [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: a886d30f-1e63-472c-b740-677cbd44d565] Took 0.82 seconds to detach 1 volumes for instance.
Oct 30 09:47:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:47:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:47:36 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:47:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:47:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:47:36 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Deleted allocations for instance a886d30f-1e63-472c-b740-677cbd44d565
Oct 30 09:47:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f0a2afcd-a110-4f84-ae87-8ef2c258ac9b tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "a886d30f-1e63-472c-b740-677cbd44d565" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:47:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:47:37 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:47:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:47:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:47:43 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:47:43 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8211MB free_disk=24.708412170410156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 13d468ad-69a5-409d-b737-188a4f1a7bda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 7e991bd7-2730-424d-af01-12401695ff4d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:47:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:47:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:47:44 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:47:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:47:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:47:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:47:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:47:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating instance_info_cache with network_info: [{"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:47:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-de224282-93e3-4f0e-a748-4e02efb80c5c" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:47:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:47:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:47:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:47:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:47:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:47:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:47:51 user nova-compute[75017]: INFO nova.compute.manager [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Detaching volume 66122ba3-0e62-46b0-b5a3-0c6594ff58b3
Oct 30 09:47:51 user nova-compute[75017]: INFO nova.virt.block_device [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Attempting to driver detach volume 66122ba3-0e62-46b0-b5a3-0c6594ff58b3 from mountpoint /dev/vdb
Oct 30 09:47:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Attempting to detach device vdb from instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:47:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:47:51 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:47:51 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:47:51 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:47:51 user nova-compute[75017]:   <serial>66122ba3-0e62-46b0-b5a3-0c6594ff58b3</serial>
Oct 30 09:47:51 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 09:47:51 user nova-compute[75017]: </disk>
Oct 30 09:47:51 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:47:51 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully detached device vdb from instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 from the persistent domain config.
Oct 30 09:47:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:47:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:47:51 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:47:51 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:47:51 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:47:51 user nova-compute[75017]:   <serial>66122ba3-0e62-46b0-b5a3-0c6594ff58b3</serial>
Oct 30 09:47:51 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 09:47:51 user nova-compute[75017]: </disk>
Oct 30 09:47:51 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:47:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:47:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:47:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Verify base images {{(pid=75017) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Image id 012fce94-6c21-44ea-a5a3-678c0b43c45e yields fingerprint 3ed0f193121c2c87472e304b04aa234ee49eab40 {{(pid=75017) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75017) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Image id bfd0d0c2-d64f-40a2-8d8e-991cce6f8585 yields fingerprint efafbd3e35bfea57f8c492884372109a458d1ba1 {{(pid=75017) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 30 09:48:03 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] image bfd0d0c2-d64f-40a2-8d8e-991cce6f8585 at (/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1): checking
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] image bfd0d0c2-d64f-40a2-8d8e-991cce6f8585 at (/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1): image is in use {{(pid=75017) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] 7e991bd7-2730-424d-af01-12401695ff4d is a valid instance name {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] 469c433e-a055-4b0d-a7f1-902cd5b13707 is a valid instance name {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] 469c433e-a055-4b0d-a7f1-902cd5b13707 has a disk file {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 is backed by efafbd3e35bfea57f8c492884372109a458d1ba1 {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] eab947f6-fbac-4685-adc7-722206413b8a is a valid instance name {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] eab947f6-fbac-4685-adc7-722206413b8a has a disk file {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance eab947f6-fbac-4685-adc7-722206413b8a is backed by efafbd3e35bfea57f8c492884372109a458d1ba1 {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] 5279c2eb-3996-4b46-8925-81a5d7022c5f is a valid instance name {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] de224282-93e3-4f0e-a748-4e02efb80c5c is a valid instance name {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] de224282-93e3-4f0e-a748-4e02efb80c5c has a disk file {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 09:48:03 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c is backed by efafbd3e35bfea57f8c492884372109a458d1ba1 {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 is a valid instance name {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 has a disk file {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 is backed by efafbd3e35bfea57f8c492884372109a458d1ba1 {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] 13d468ad-69a5-409d-b737-188a4f1a7bda is a valid instance name {{(pid=75017) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 09:48:04 user nova-compute[75017]: WARNING nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4
Oct 30 09:48:04 user nova-compute[75017]: WARNING nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5
Oct 30 09:48:04 user nova-compute[75017]: WARNING nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a
Oct 30 09:48:04 user nova-compute[75017]: WARNING nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc
Oct 30 09:48:04 user nova-compute[75017]: WARNING nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f
Oct 30 09:48:04 user nova-compute[75017]: WARNING nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb
Oct 30 09:48:04 user nova-compute[75017]: WARNING nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623
Oct 30 09:48:04 user nova-compute[75017]: WARNING nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2
Oct 30 09:48:04 user nova-compute[75017]: WARNING nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Active base files: /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Removable base files: /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4 /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5 /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623 /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2 /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0bebbd27eccad003710d0331b4eac4e5b1736de4
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d4a769a7722947c845d1338b7e0411eb8c3e4bf5
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b2464f82ac6bde8cada4da5660f373b8248b890a
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/93374d8f65a1dec126e646ce3bb973d4239bd2cc
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/49c635040233db6138d31f075b64e84f2cc39d0f
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cdf7d587091a559f8c44542e06c1a727b6cfaebb
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/00409fd0d8d32e703080b707084d4c0a01f43623
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8e1ecec68478061cdafff799670f2cf1d239e3d2
Oct 30 09:48:04 user nova-compute[75017]: INFO nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3b6cec079a8154913073e460a656d2646d9ec5ff
Oct 30 09:48:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Verification complete {{(pid=75017) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Verify swap images {{(pid=75017) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 30 09:48:04 user nova-compute[75017]: DEBUG nova.virt.libvirt.imagecache [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Verify ephemeral images {{(pid=75017) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 30 09:48:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:12 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 is timed out.
Oct 30 09:48:12 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully detached device vdb from instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 from the live domain config.
Oct 30 09:48:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIhROCfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:48:12 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed94c23-d74e-4058-b6f8-c539817e00ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:48:12 user nova-compute[75017]: No targets found.
Oct 30 09:48:12 user nova-compute[75017]: iSNS:
Oct 30 09:48:12 user nova-compute[75017]: No targets found.
Oct 30 09:48:12 user nova-compute[75017]: STATIC:
Oct 30 09:48:12 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:48:12 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:48:12 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:48:12 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c
Oct 30 09:48:12 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:48:12 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:48:12 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c
Oct 30 09:48:12 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:48:12 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:48:12 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3
Oct 30 09:48:12 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:48:12 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:48:12 user nova-compute[75017]: FIRMWARE:
Oct 30 09:48:12 user nova-compute[75017]: No targets found.
Oct 30 09:48:12 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:48:12 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:48:12 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd222a-792a-4937-966d-a1b12e329427]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae7cb95-b8d1-450b-8ae1-dbc11b7be8d1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:48:12 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:48:12 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:48:12 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:48:12 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:48:12 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:48:12 user nova-compute[75017]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 (non-flash)
Oct 30 09:48:12 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:48:12 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d1016ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3'): ({'sdd'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Removing single pathed devices sdd {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65f4356-fadc-4362-85af-db74273c5875]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[911f9a69-74af-4424-a6ce-dde942959af0]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flushing IO for device /dev/sdd {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2156aa6-2e69-436c-a83a-25edad1e657e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1ec5d-0261-4b29-922b-3b81a6f97767]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eba292-bae8-4a93-aca1-813a8c87b219]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[790433b8-393c-46ae-b36d-835e87b9adca]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260]
Oct 30 09:48:12 user nova-compute[75017]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3, portal: 172.16.0.220,3260] successful.
Oct 30 09:48:12 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66122ba3-0e62-46b0-b5a3-0c6594ff58b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[145f1c30-47a6-4487-926c-d719baf696cc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== disconnect_volume: return (354ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:48:12 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:48:13 user nova-compute[75017]: DEBUG nova.objects.instance [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:48:13 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-50bceac4-c245-4c2c-b4fc-ece25f316176 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.956s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-684f3e62-022b-4571-8f95-fa3b713cfafc tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-684f3e62-022b-4571-8f95-fa3b713cfafc tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-684f3e62-022b-4571-8f95-fa3b713cfafc tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-684f3e62-022b-4571-8f95-fa3b713cfafc tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75017) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG nova.objects.instance [None req-684f3e62-022b-4571-8f95-fa3b713cfafc tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-7aea5323-29b9-43ee-ba9c-fa638fa0c3b1 req-27179f24-cfba-4128-ba57-346db41f9d2b service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7aea5323-29b9-43ee-ba9c-fa638fa0c3b1 req-27179f24-cfba-4128-ba57-346db41f9d2b service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7aea5323-29b9-43ee-ba9c-fa638fa0c3b1 req-27179f24-cfba-4128-ba57-346db41f9d2b service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-7aea5323-29b9-43ee-ba9c-fa638fa0c3b1 req-27179f24-cfba-4128-ba57-346db41f9d2b service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-7aea5323-29b9-43ee-ba9c-fa638fa0c3b1 req-27179f24-cfba-4128-ba57-346db41f9d2b service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:48:14 user nova-compute[75017]: WARNING nova.compute.manager [req-7aea5323-29b9-43ee-ba9c-fa638fa0c3b1 req-27179f24-cfba-4128-ba57-346db41f9d2b service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state active and task_state powering-off.
Oct 30 09:48:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:14 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance destroyed successfully.
Oct 30 09:48:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-684f3e62-022b-4571-8f95-fa3b713cfafc tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:48:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-684f3e62-022b-4571-8f95-fa3b713cfafc tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.862s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-ca85a28c-4cf0-4429-8a93-b505b9e43b3b req-677c67f8-b68b-45fb-9150-8a4fd005c818 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ca85a28c-4cf0-4429-8a93-b505b9e43b3b req-677c67f8-b68b-45fb-9150-8a4fd005c818 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ca85a28c-4cf0-4429-8a93-b505b9e43b3b req-677c67f8-b68b-45fb-9150-8a4fd005c818 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:16 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ca85a28c-4cf0-4429-8a93-b505b9e43b3b req-677c67f8-b68b-45fb-9150-8a4fd005c818 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-ca85a28c-4cf0-4429-8a93-b505b9e43b3b req-677c67f8-b68b-45fb-9150-8a4fd005c818 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:48:16 user nova-compute[75017]: WARNING nova.compute.manager [req-ca85a28c-4cf0-4429-8a93-b505b9e43b3b req-677c67f8-b68b-45fb-9150-8a4fd005c818 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state None.
Oct 30 09:48:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "eab947f6-fbac-4685-adc7-722206413b8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "eab947f6-fbac-4685-adc7-722206413b8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "eab947f6-fbac-4685-adc7-722206413b8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:23 user nova-compute[75017]: INFO nova.compute.manager [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Terminating instance
Oct 30 09:48:23 user nova-compute[75017]: DEBUG nova.compute.manager [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-0c099413-bfbc-4d38-b4af-a7363f779f75 req-bbe84c4e-a84d-45de-80fe-fe50fd646b5c service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received event network-vif-unplugged-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0c099413-bfbc-4d38-b4af-a7363f779f75 req-bbe84c4e-a84d-45de-80fe-fe50fd646b5c service nova] Acquiring lock "eab947f6-fbac-4685-adc7-722206413b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0c099413-bfbc-4d38-b4af-a7363f779f75 req-bbe84c4e-a84d-45de-80fe-fe50fd646b5c service nova] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0c099413-bfbc-4d38-b4af-a7363f779f75 req-bbe84c4e-a84d-45de-80fe-fe50fd646b5c service nova] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-0c099413-bfbc-4d38-b4af-a7363f779f75 req-bbe84c4e-a84d-45de-80fe-fe50fd646b5c service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] No waiting events found dispatching network-vif-unplugged-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-0c099413-bfbc-4d38-b4af-a7363f779f75 req-bbe84c4e-a84d-45de-80fe-fe50fd646b5c service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received event network-vif-unplugged-5a158522-5fa3-4331-9ded-b6a4aead610b for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Instance destroyed successfully.
Oct 30 09:48:24 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'resources' on Instance uuid eab947f6-fbac-4685-adc7-722206413b8a {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124615992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124615992',id=42,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:38:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-ygchr2d7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:40:09Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=eab947f6-fbac-4685-adc7-722206413b8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "5a158522-5fa3-4331-9ded-b6a4aead610b", "address": "fa:16:3e:09:8c:7c", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a158522-5f", "ovs_interfaceid": "5a158522-5fa3-4331-9ded-b6a4aead610b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=5a158522-5fa3-4331-9ded-b6a4aead610b,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a158522-5f') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG os_vif [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=5a158522-5fa3-4331-9ded-b6a4aead610b,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a158522-5f') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a158522-5f, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9124078-6e96-43be-a25a-645c380ff8c1) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:24 user nova-compute[75017]: INFO os_vif [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=5a158522-5fa3-4331-9ded-b6a4aead610b,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a158522-5f')
Oct 30 09:48:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Deleting instance files /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a_del
Oct 30 09:48:24 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Deletion of /opt/stack/data/nova/instances/eab947f6-fbac-4685-adc7-722206413b8a_del complete
Oct 30 09:48:24 user nova-compute[75017]: INFO nova.compute.manager [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 30 09:48:24 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:48:24 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: eab947f6-fbac-4685-adc7-722206413b8a] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:48:25 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:48:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-f2c52da2-fd8d-48e7-a14c-c8bcc1f91139 req-09e27dce-1caa-4d2f-90b0-0ab3db2ab145 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received event network-vif-deleted-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:25 user nova-compute[75017]: INFO nova.compute.manager [req-f2c52da2-fd8d-48e7-a14c-c8bcc1f91139 req-09e27dce-1caa-4d2f-90b0-0ab3db2ab145 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Neutron deleted interface 5a158522-5fa3-4331-9ded-b6a4aead610b; detaching it from the instance and deleting it from the info cache
Oct 30 09:48:25 user nova-compute[75017]: DEBUG nova.network.neutron [req-f2c52da2-fd8d-48e7-a14c-c8bcc1f91139 req-09e27dce-1caa-4d2f-90b0-0ab3db2ab145 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:48:25 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Took 0.51 seconds to deallocate network for instance.
Oct 30 09:48:25 user nova-compute[75017]: DEBUG nova.compute.manager [req-f2c52da2-fd8d-48e7-a14c-c8bcc1f91139 req-09e27dce-1caa-4d2f-90b0-0ab3db2ab145 service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Detach interface failed, port_id=5a158522-5fa3-4331-9ded-b6a4aead610b, reason: Instance eab947f6-fbac-4685-adc7-722206413b8a could not be found. {{(pid=75017) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 09:48:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:25 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:48:25 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:48:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:25 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Deleted allocations for instance eab947f6-fbac-4685-adc7-722206413b8a
Oct 30 09:48:25 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d1fa6c1e-5ce8-44eb-b2c3-91ffbd800d13 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "eab947f6-fbac-4685-adc7-722206413b8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.677s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-b4ed909f-1684-4cd5-b424-53443d50321a req-466f71d8-514a-401f-965f-345292cf9ecc service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received event network-vif-plugged-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4ed909f-1684-4cd5-b424-53443d50321a req-466f71d8-514a-401f-965f-345292cf9ecc service nova] Acquiring lock "eab947f6-fbac-4685-adc7-722206413b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4ed909f-1684-4cd5-b424-53443d50321a req-466f71d8-514a-401f-965f-345292cf9ecc service nova] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-b4ed909f-1684-4cd5-b424-53443d50321a req-466f71d8-514a-401f-965f-345292cf9ecc service nova] Lock "eab947f6-fbac-4685-adc7-722206413b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:26 user nova-compute[75017]: DEBUG nova.compute.manager [req-b4ed909f-1684-4cd5-b424-53443d50321a req-466f71d8-514a-401f-965f-345292cf9ecc service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] No waiting events found dispatching network-vif-plugged-5a158522-5fa3-4331-9ded-b6a4aead610b {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:48:26 user nova-compute[75017]: WARNING nova.compute.manager [req-b4ed909f-1684-4cd5-b424-53443d50321a req-466f71d8-514a-401f-965f-345292cf9ecc service nova] [instance: eab947f6-fbac-4685-adc7-722206413b8a] Received unexpected event network-vif-plugged-5a158522-5fa3-4331-9ded-b6a4aead610b for instance with vm_state deleted and task_state None.
Oct 30 09:48:29 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:29 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:48:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-ee0987e8-4f94-4621-8604-3fa4e8220782 req-7e1b29a9-7a3b-439f-a337-f4049a834c79 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received event network-changed-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-ee0987e8-4f94-4621-8604-3fa4e8220782 req-7e1b29a9-7a3b-439f-a337-f4049a834c79 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Refreshing instance network info cache due to event network-changed-70c89b68-e032-4f89-9294-8f386a26eb27. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:48:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ee0987e8-4f94-4621-8604-3fa4e8220782 req-7e1b29a9-7a3b-439f-a337-f4049a834c79 service nova] Acquiring lock "refresh_cache-7e991bd7-2730-424d-af01-12401695ff4d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:48:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ee0987e8-4f94-4621-8604-3fa4e8220782 req-7e1b29a9-7a3b-439f-a337-f4049a834c79 service nova] Acquired lock "refresh_cache-7e991bd7-2730-424d-af01-12401695ff4d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:48:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-ee0987e8-4f94-4621-8604-3fa4e8220782 req-7e1b29a9-7a3b-439f-a337-f4049a834c79 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Refreshing network info cache for port 70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:48:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-ee0987e8-4f94-4621-8604-3fa4e8220782 req-7e1b29a9-7a3b-439f-a337-f4049a834c79 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Updated VIF entry in instance network info cache for port 70c89b68-e032-4f89-9294-8f386a26eb27. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:48:31 user nova-compute[75017]: DEBUG nova.network.neutron [req-ee0987e8-4f94-4621-8604-3fa4e8220782 req-7e1b29a9-7a3b-439f-a337-f4049a834c79 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Updating instance_info_cache with network_info: [{"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:48:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ee0987e8-4f94-4621-8604-3fa4e8220782 req-7e1b29a9-7a3b-439f-a337-f4049a834c79 service nova] Releasing lock "refresh_cache-7e991bd7-2730-424d-af01-12401695ff4d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "7e991bd7-2730-424d-af01-12401695ff4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "7e991bd7-2730-424d-af01-12401695ff4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "7e991bd7-2730-424d-af01-12401695ff4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:32 user nova-compute[75017]: INFO nova.compute.manager [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Terminating instance
Oct 30 09:48:32 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-bd101e23-a009-4826-939b-81ee4a2597cc req-42f65db4-5af2-4bee-9add-44cb138474c2 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received event network-vif-unplugged-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bd101e23-a009-4826-939b-81ee4a2597cc req-42f65db4-5af2-4bee-9add-44cb138474c2 service nova] Acquiring lock "7e991bd7-2730-424d-af01-12401695ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bd101e23-a009-4826-939b-81ee4a2597cc req-42f65db4-5af2-4bee-9add-44cb138474c2 service nova] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-bd101e23-a009-4826-939b-81ee4a2597cc req-42f65db4-5af2-4bee-9add-44cb138474c2 service nova] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-bd101e23-a009-4826-939b-81ee4a2597cc req-42f65db4-5af2-4bee-9add-44cb138474c2 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] No waiting events found dispatching network-vif-unplugged-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG nova.compute.manager [req-bd101e23-a009-4826-939b-81ee4a2597cc req-42f65db4-5af2-4bee-9add-44cb138474c2 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received event network-vif-unplugged-70c89b68-e032-4f89-9294-8f386a26eb27 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Instance destroyed successfully.
Oct 30 09:48:32 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'resources' on Instance uuid 7e991bd7-2730-424d-af01-12401695ff4d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1069939648',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1069939648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1069939648',id=48,image_ref='012fce94-6c21-44ea-a5a3-678c0b43c45e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTgA/3kcpLag4JQvk5Q82iHsT44BQwLZibCRkWMxpiS5C20fEDhB3lsicGe3PX3Ht5Rcfua5aAaasR535hou6AsMPgPV0XHiUS/JmH5/Cxz1OVG+BX4+tX9QEqaWuyuCA==',key_name='tempest-keypair-901833419',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:46:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-nsf6ph1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2136848934',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd23876ced14c21a33d3c13100323a3',uuid=7e991bd7-2730-424d-af01-12401695ff4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "70c89b68-e032-4f89-9294-8f386a26eb27", "address": "fa:16:3e:f6:a9:29", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c89b68-e0", "ovs_interfaceid": "70c89b68-e032-4f89-9294-8f386a26eb27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:a9:29,bridge_name='br-int',has_traffic_filtering=True,id=70c89b68-e032-4f89-9294-8f386a26eb27,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c89b68-e0') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG os_vif [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:a9:29,bridge_name='br-int',has_traffic_filtering=True,id=70c89b68-e032-4f89-9294-8f386a26eb27,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c89b68-e0') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70c89b68-e0, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db84129a-748c-490d-8ad1-d13c2a9912ce) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:32 user nova-compute[75017]: INFO os_vif [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:a9:29,bridge_name='br-int',has_traffic_filtering=True,id=70c89b68-e032-4f89-9294-8f386a26eb27,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c89b68-e0')
Oct 30 09:48:32 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZxphvDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:48:32 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:48:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca30b21-078e-4d84-8c85-4309120d89c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:48:32 user nova-compute[75017]: No targets found.
Oct 30 09:48:32 user nova-compute[75017]: iSNS:
Oct 30 09:48:32 user nova-compute[75017]: No targets found.
Oct 30 09:48:32 user nova-compute[75017]: STATIC:
Oct 30 09:48:32 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:48:32 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:48:32 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:48:32 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c
Oct 30 09:48:32 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:48:32 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:48:32 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c
Oct 30 09:48:32 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:48:32 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:48:32 user nova-compute[75017]: FIRMWARE:
Oct 30 09:48:32 user nova-compute[75017]: No targets found.
Oct 30 09:48:32 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:48:32 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:48:32 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:32 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[37da8596-3577-4518-b603-9c8e8dec8f2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e95ae1c-c216-4976-8d0b-5e5e7b89cbc2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:48:33 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:48:33 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:48:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:48:33 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:48:33 user nova-compute[75017]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c (non-flash)
Oct 30 09:48:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccdb08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c'): ({'sdg'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Removing single pathed devices sdg {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[51995ad3-e787-420d-9cbd-50f41fd8ba39]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c75646-efcd-473a-92d0-32ee6ab61bd6]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flushing IO for device /dev/sdg {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9329c6ac-38ce-4fbc-b075-4ae3d92c008c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b725bbaf-55f9-4fc1-acf2-b869b07323ba]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] SCSI volumes sdg have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e0cff-04db-4c0c-b258-bb46c19dec86]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c33d2a-2ad4-4487-9398-9fa481f75b85]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c, portal: 172.16.0.220,3260]
Oct 30 09:48:33 user nova-compute[75017]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c, portal: 172.16.0.220,3260] successful.
Oct 30 09:48:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd5e1656-6d21-4602-a899-463794744d1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5528a6-b94a-466c-a5b4-e1cdf245ab2a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== disconnect_volume: return (324ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:48:33 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Deleting instance files /opt/stack/data/nova/instances/7e991bd7-2730-424d-af01-12401695ff4d_del
Oct 30 09:48:33 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Deletion of /opt/stack/data/nova/instances/7e991bd7-2730-424d-af01-12401695ff4d_del complete
Oct 30 09:48:33 user nova-compute[75017]: INFO nova.compute.manager [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 30 09:48:33 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:48:33 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:48:34 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:48:34 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Took 0.69 seconds to deallocate network for instance.
Oct 30 09:48:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-9f6ef8c3-eb7a-46f6-9ff4-222fa0eb14c9 req-c982aa5a-ef3c-4950-8580-1ce36269f832 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received event network-vif-plugged-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9f6ef8c3-eb7a-46f6-9ff4-222fa0eb14c9 req-c982aa5a-ef3c-4950-8580-1ce36269f832 service nova] Acquiring lock "7e991bd7-2730-424d-af01-12401695ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9f6ef8c3-eb7a-46f6-9ff4-222fa0eb14c9 req-c982aa5a-ef3c-4950-8580-1ce36269f832 service nova] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9f6ef8c3-eb7a-46f6-9ff4-222fa0eb14c9 req-c982aa5a-ef3c-4950-8580-1ce36269f832 service nova] Lock "7e991bd7-2730-424d-af01-12401695ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-9f6ef8c3-eb7a-46f6-9ff4-222fa0eb14c9 req-c982aa5a-ef3c-4950-8580-1ce36269f832 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] No waiting events found dispatching network-vif-plugged-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:48:34 user nova-compute[75017]: WARNING nova.compute.manager [req-9f6ef8c3-eb7a-46f6-9ff4-222fa0eb14c9 req-c982aa5a-ef3c-4950-8580-1ce36269f832 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received unexpected event network-vif-plugged-70c89b68-e032-4f89-9294-8f386a26eb27 for instance with vm_state active and task_state deleting.
Oct 30 09:48:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-9f6ef8c3-eb7a-46f6-9ff4-222fa0eb14c9 req-c982aa5a-ef3c-4950-8580-1ce36269f832 service nova] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Received event network-vif-deleted-70c89b68-e032-4f89-9294-8f386a26eb27 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:34 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:34 user nova-compute[75017]: INFO nova.compute.manager [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Took 0.88 seconds to detach 1 volumes for instance.
Oct 30 09:48:34 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 7e991bd7-2730-424d-af01-12401695ff4d] Deleting volume: bd5e1656-6d21-4602-a899-463794744d1c {{(pid=75017) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 09:48:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:35 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:48:35 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:48:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:35 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Deleted allocations for instance 7e991bd7-2730-424d-af01-12401695ff4d
Oct 30 09:48:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a7e46e82-fe4c-4cf8-9933-4177a3afcdce tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "7e991bd7-2730-424d-af01-12401695ff4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.261s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:48:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:48:42 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:43 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:48:43 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8559MB free_disk=24.831859588623047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 5279c2eb-3996-4b46-8925-81a5d7022c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance de224282-93e3-4f0e-a748-4e02efb80c5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 13d468ad-69a5-409d-b737-188a4f1a7bda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:48:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:44 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:48:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:48:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:48:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:48:45 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating instance_info_cache with network_info: [{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:48:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:48:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:48 user nova-compute[75017]: INFO nova.compute.manager [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Terminating instance
Oct 30 09:48:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-cc099c8f-55d8-4062-81b1-9a75ee8f3fa0 req-3b690a93-1d8f-4013-a706-71d6ff82d267 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received event network-vif-unplugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cc099c8f-55d8-4062-81b1-9a75ee8f3fa0 req-3b690a93-1d8f-4013-a706-71d6ff82d267 service nova] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cc099c8f-55d8-4062-81b1-9a75ee8f3fa0 req-3b690a93-1d8f-4013-a706-71d6ff82d267 service nova] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-cc099c8f-55d8-4062-81b1-9a75ee8f3fa0 req-3b690a93-1d8f-4013-a706-71d6ff82d267 service nova] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-cc099c8f-55d8-4062-81b1-9a75ee8f3fa0 req-3b690a93-1d8f-4013-a706-71d6ff82d267 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] No waiting events found dispatching network-vif-unplugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:48:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-cc099c8f-55d8-4062-81b1-9a75ee8f3fa0 req-3b690a93-1d8f-4013-a706-71d6ff82d267 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received event network-vif-unplugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Instance destroyed successfully.
Oct 30 09:48:49 user nova-compute[75017]: DEBUG nova.objects.instance [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lazy-loading 'resources' on Instance uuid de224282-93e3-4f0e-a748-4e02efb80c5c {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1303515731',display_name='tempest-SnapshotDataIntegrityTests-server-1303515731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1303515731',id=43,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCODsMUfOS3Ke+UbZA5lUyPNeDAaBwk6qVhLAkTNA94kHz26WKyIbbFkQb5lUTWGj+DJEEoyqW96nZMopgGiofYdCJnVo8BqpAbk0FWNO7tmbS4MhTfkdA29c3P/H6roCQ==',key_name='tempest-keypair-1050333528',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c547c8abc6bd4614983ab093e82bb601',ramdisk_id='',reservation_id='r-murkgm03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1686524374',owner_user_name='tempest-SnapshotDataIntegrityTests-1686524374-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c10df82a3ff442769998b70e982ebbb9',uuid=de224282-93e3-4f0e-a748-4e02efb80c5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Converting VIF {"id": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "address": "fa:16:3e:7e:c0:c5", "network": {"id": "466a97ed-985f-4b35-85a2-25a98f6916ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749583394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c547c8abc6bd4614983ab093e82bb601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72925f7f-38", "ovs_interfaceid": "72925f7f-38eb-44a2-95a5-5e57b7d693a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=72925f7f-38eb-44a2-95a5-5e57b7d693a6,network=Network(466a97ed-985f-4b35-85a2-25a98f6916ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72925f7f-38') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG os_vif [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=72925f7f-38eb-44a2-95a5-5e57b7d693a6,network=Network(466a97ed-985f-4b35-85a2-25a98f6916ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72925f7f-38') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72925f7f-38, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9502ebcd-b7e1-4c90-b13c-59c70ee157b3) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:49 user nova-compute[75017]: INFO os_vif [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=72925f7f-38eb-44a2-95a5-5e57b7d693a6,network=Network(466a97ed-985f-4b35-85a2-25a98f6916ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72925f7f-38')
Oct 30 09:48:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Deleting instance files /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c_del
Oct 30 09:48:49 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Deletion of /opt/stack/data/nova/instances/de224282-93e3-4f0e-a748-4e02efb80c5c_del complete
Oct 30 09:48:49 user nova-compute[75017]: INFO nova.compute.manager [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 30 09:48:49 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:48:49 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:48:50 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Took 0.91 seconds to deallocate network for instance.
Oct 30 09:48:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:50 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Deleted allocations for instance de224282-93e3-4f0e-a748-4e02efb80c5c
Oct 30 09:48:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-a3d0cfc3-6c1b-4562-a256-7d2c8cceeb80 tempest-SnapshotDataIntegrityTests-1686524374 tempest-SnapshotDataIntegrityTests-1686524374-project-member] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-d9fcf0ee-983d-4ce8-b84d-c7486a468cc4 req-d809f6e9-3a5a-4efd-b27d-ea3d092a1381 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received event network-vif-plugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d9fcf0ee-983d-4ce8-b84d-c7486a468cc4 req-d809f6e9-3a5a-4efd-b27d-ea3d092a1381 service nova] Acquiring lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d9fcf0ee-983d-4ce8-b84d-c7486a468cc4 req-d809f6e9-3a5a-4efd-b27d-ea3d092a1381 service nova] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d9fcf0ee-983d-4ce8-b84d-c7486a468cc4 req-d809f6e9-3a5a-4efd-b27d-ea3d092a1381 service nova] Lock "de224282-93e3-4f0e-a748-4e02efb80c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:48:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-d9fcf0ee-983d-4ce8-b84d-c7486a468cc4 req-d809f6e9-3a5a-4efd-b27d-ea3d092a1381 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] No waiting events found dispatching network-vif-plugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:48:50 user nova-compute[75017]: WARNING nova.compute.manager [req-d9fcf0ee-983d-4ce8-b84d-c7486a468cc4 req-d809f6e9-3a5a-4efd-b27d-ea3d092a1381 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received unexpected event network-vif-plugged-72925f7f-38eb-44a2-95a5-5e57b7d693a6 for instance with vm_state deleted and task_state None.
Oct 30 09:48:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-d9fcf0ee-983d-4ce8-b84d-c7486a468cc4 req-d809f6e9-3a5a-4efd-b27d-ea3d092a1381 service nova] [instance: de224282-93e3-4f0e-a748-4e02efb80c5c] Received event network-vif-deleted-72925f7f-38eb-44a2-95a5-5e57b7d693a6 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:48:51 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:51 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:48:51 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:48:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:54 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:55 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:48:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:48:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:48:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:48:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:48:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:48:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:49:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:49:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:49:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:49:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:14 user nova-compute[75017]: INFO nova.compute.manager [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Terminating instance
Oct 30 09:49:14 user nova-compute[75017]: DEBUG nova.compute.manager [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-9fb65709-8933-417f-88b2-717af34eabb1 req-faa27ae9-a2b7-4cd3-a6ec-1b6c1c4dbf90 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-unplugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9fb65709-8933-417f-88b2-717af34eabb1 req-faa27ae9-a2b7-4cd3-a6ec-1b6c1c4dbf90 service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9fb65709-8933-417f-88b2-717af34eabb1 req-faa27ae9-a2b7-4cd3-a6ec-1b6c1c4dbf90 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9fb65709-8933-417f-88b2-717af34eabb1 req-faa27ae9-a2b7-4cd3-a6ec-1b6c1c4dbf90 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-9fb65709-8933-417f-88b2-717af34eabb1 req-faa27ae9-a2b7-4cd3-a6ec-1b6c1c4dbf90 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-unplugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG nova.compute.manager [req-9fb65709-8933-417f-88b2-717af34eabb1 req-faa27ae9-a2b7-4cd3-a6ec-1b6c1c4dbf90 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-unplugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:49:14 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 469c433e-a055-4b0d-a7f1-902cd5b13707 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Triggering sync for uuid 13d468ad-69a5-409d-b737-188a4f1a7bda {{(pid=75017) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "469c433e-a055-4b0d-a7f1-902cd5b13707" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "13d468ad-69a5-409d-b737-188a4f1a7bda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Instance destroyed successfully.
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.objects.instance [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'resources' on Instance uuid 5279c2eb-3996-4b46-8925-81a5d7022c5f {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2128039297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2128039297',id=39,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:34:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-3b9q1b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:36:26Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=5279c2eb-3996-4b46-8925-81a5d7022c5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "address": "fa:16:3e:fe:06:69", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb857c2d6-78", "ovs_interfaceid": "b857c2d6-780f-4bb7-a3cc-722b83e893d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:06:69,bridge_name='br-int',has_traffic_filtering=True,id=b857c2d6-780f-4bb7-a3cc-722b83e893d4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb857c2d6-78') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_vif [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:06:69,bridge_name='br-int',has_traffic_filtering=True,id=b857c2d6-780f-4bb7-a3cc-722b83e893d4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb857c2d6-78') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb857c2d6-78, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d23e9ee-3281-4293-9bb9-64dee0503da5) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:15 user nova-compute[75017]: INFO os_vif [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:06:69,bridge_name='br-int',has_traffic_filtering=True,id=b857c2d6-780f-4bb7-a3cc-722b83e893d4,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb857c2d6-78')
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msADnxTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:49:15 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4bad5b-5c38-465f-967c-71feef614d31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:49:15 user nova-compute[75017]: No targets found.
Oct 30 09:49:15 user nova-compute[75017]: iSNS:
Oct 30 09:49:15 user nova-compute[75017]: No targets found.
Oct 30 09:49:15 user nova-compute[75017]: STATIC:
Oct 30 09:49:15 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0
Oct 30 09:49:15 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:49:15 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:49:15 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c
Oct 30 09:49:15 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:49:15 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:49:15 user nova-compute[75017]: FIRMWARE:
Oct 30 09:49:15 user nova-compute[75017]: No targets found.
Oct 30 09:49:15 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:49:15 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:49:15 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22630b6-324a-4d35-b8a3-9884f9200704]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6959af94-7521-44f0-9854-82d20afdab32]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:49:15 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:49:15 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 (non-flash)
Oct 30 09:49:15 user nova-compute[75017]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:49:15 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccb0c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0'): ({'sde'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Removing single pathed devices sde {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1644254d-3f8e-4759-9202-5d9440b556dd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[87639302-c003-48ff-98dc-c05d9894477e]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Flushing IO for device /dev/sde {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[791ac17c-f5cb-4716-b6ad-f4a3087e05ab]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80bb0b0-a633-4e15-910c-160940464ca3]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a96247-5a73-4e4a-9291-151858e7f3e2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc88318-7bd8-4774-96e4-c3d1b918a0b0]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0, portal: 172.16.0.220,3260]
Oct 30 09:49:15 user nova-compute[75017]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0, portal: 172.16.0.220,3260] successful.
Oct 30 09:49:15 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca80d7d-9669-44b0-a3bf-5ec837f3acb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f2133e-9e2b-4a6a-9648-412256d5c03a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] <== disconnect_volume: return (293ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:49:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Deleting instance files /opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f_del
Oct 30 09:49:15 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Deletion of /opt/stack/data/nova/instances/5279c2eb-3996-4b46-8925-81a5d7022c5f_del complete
Oct 30 09:49:15 user nova-compute[75017]: INFO nova.compute.manager [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 30 09:49:15 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:49:15 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:49:16 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:49:16 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Took 0.63 seconds to deallocate network for instance.
Oct 30 09:49:16 user nova-compute[75017]: DEBUG nova.compute.manager [req-0b53df50-e426-48bc-996a-a9b56f8cdfe9 req-490822a8-5ac9-4e41-8a26-693161d5fcb9 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-deleted-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-a7caaa5e-4322-4cc1-8c73-3f130b15f0b7 req-06ae7bea-2e40-4592-9ae8-b572f7e4b978 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a7caaa5e-4322-4cc1-8c73-3f130b15f0b7 req-06ae7bea-2e40-4592-9ae8-b572f7e4b978 service nova] Acquiring lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a7caaa5e-4322-4cc1-8c73-3f130b15f0b7 req-06ae7bea-2e40-4592-9ae8-b572f7e4b978 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-a7caaa5e-4322-4cc1-8c73-3f130b15f0b7 req-06ae7bea-2e40-4592-9ae8-b572f7e4b978 service nova] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG nova.compute.manager [req-a7caaa5e-4322-4cc1-8c73-3f130b15f0b7 req-06ae7bea-2e40-4592-9ae8-b572f7e4b978 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] No waiting events found dispatching network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:49:17 user nova-compute[75017]: WARNING nova.compute.manager [req-a7caaa5e-4322-4cc1-8c73-3f130b15f0b7 req-06ae7bea-2e40-4592-9ae8-b572f7e4b978 service nova] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Received unexpected event network-vif-plugged-b857c2d6-780f-4bb7-a3cc-722b83e893d4 for instance with vm_state active and task_state deleting.
Oct 30 09:49:17 user nova-compute[75017]: INFO nova.compute.manager [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] Took 0.84 seconds to detach 1 volumes for instance.
Oct 30 09:49:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:17 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Deleted allocations for instance 5279c2eb-3996-4b46-8925-81a5d7022c5f
Oct 30 09:49:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-27974b9c-1ea6-4c0d-bf4b-7df4d5557932 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.088s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.248s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:17 user nova-compute[75017]: INFO nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 5279c2eb-3996-4b46-8925-81a5d7022c5f] During sync_power_state the instance has a pending task (deleting). Skip.
Oct 30 09:49:17 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "5279c2eb-3996-4b46-8925-81a5d7022c5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:20 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:25 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:30 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "13d468ad-69a5-409d-b737-188a4f1a7bda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:33 user nova-compute[75017]: INFO nova.compute.manager [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Terminating instance
Oct 30 09:49:33 user nova-compute[75017]: DEBUG nova.compute.manager [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-840a5717-e985-49c0-88b7-58dd029bb42b req-a8e4db94-0eac-4d7f-b0a2-4eada1f6f099 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received event network-vif-unplugged-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-840a5717-e985-49c0-88b7-58dd029bb42b req-a8e4db94-0eac-4d7f-b0a2-4eada1f6f099 service nova] Acquiring lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-840a5717-e985-49c0-88b7-58dd029bb42b req-a8e4db94-0eac-4d7f-b0a2-4eada1f6f099 service nova] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-840a5717-e985-49c0-88b7-58dd029bb42b req-a8e4db94-0eac-4d7f-b0a2-4eada1f6f099 service nova] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-840a5717-e985-49c0-88b7-58dd029bb42b req-a8e4db94-0eac-4d7f-b0a2-4eada1f6f099 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] No waiting events found dispatching network-vif-unplugged-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG nova.compute.manager [req-840a5717-e985-49c0-88b7-58dd029bb42b req-a8e4db94-0eac-4d7f-b0a2-4eada1f6f099 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received event network-vif-unplugged-1a5e045c-628a-4c84-ba60-dae49f823989 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:49:33 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Instance destroyed successfully.
Oct 30 09:49:33 user nova-compute[75017]: DEBUG nova.objects.instance [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'resources' on Instance uuid 13d468ad-69a5-409d-b737-188a4f1a7bda {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1587446584',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1587446584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1587446584',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIwaZyIobthabPRI2gaNshu/g28y+xIeNUS39Z8+5KMotuzMT1Ro88s/ZfbOFbEwPkea5M8WqXjMIZH5P/hAgV6xpfjKjqcErYiKiLp5GYeEkBSJG9s39Cbcqb70vPYVQ==',key_name='tempest-keypair-1212348368',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-b8dri09r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd23876ced14c21a33d3c13100323a3',uuid=13d468ad-69a5-409d-b737-188a4f1a7bda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "1a5e045c-628a-4c84-ba60-dae49f823989", "address": "fa:16:3e:9d:89:6d", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5e045c-62", "ovs_interfaceid": "1a5e045c-628a-4c84-ba60-dae49f823989", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=1a5e045c-628a-4c84-ba60-dae49f823989,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a5e045c-62') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_vif [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=1a5e045c-628a-4c84-ba60-dae49f823989,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a5e045c-62') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a5e045c-62, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d34efc8-9c07-4332-a00e-c76a035f41f1) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:33 user nova-compute[75017]: INFO os_vif [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=1a5e045c-628a-4c84-ba60-dae49f823989,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a5e045c-62')
Oct 30 09:49:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQwHPbKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:49:33 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c3d9de-45bd-42c5-b734-6cdf6d23ed3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:49:33 user nova-compute[75017]: No targets found.
Oct 30 09:49:33 user nova-compute[75017]: iSNS:
Oct 30 09:49:33 user nova-compute[75017]: No targets found.
Oct 30 09:49:33 user nova-compute[75017]: STATIC:
Oct 30 09:49:33 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c
Oct 30 09:49:33 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:49:33 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:49:33 user nova-compute[75017]: FIRMWARE:
Oct 30 09:49:33 user nova-compute[75017]: No targets found.
Oct 30 09:49:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:49:33 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:49:33 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5496d8-f627-4c35-992b-5f515fa21d14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21a2cd4-f247-4df9-b1b2-3be195d4d474]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:49:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c (non-flash)
Oct 30 09:49:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ccccdf2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[494fea6b-e169-4734-86bd-910e77c5420b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[75af60c0-720a-4e44-9913-d9ddcd26d2db]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c83975-581f-4a6d-a781-59940888a5a5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b510444-d45e-40aa-918d-06a18b19b070]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe8a39a77-2ee19a671af4b388', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e8a39a77', '/dev/disk/by-id/scsi-23265653139613637') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e432cdfc-9061-420a-955d-cda25d598c2e]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2574999b-63d2-47b5-86d6-bbf9a83d1987]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59f9116-1d85-41ed-a42c-64a946cf1a2b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c, portal: 172.16.0.220,3260]
Oct 30 09:49:34 user nova-compute[75017]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c, portal: 172.16.0.220,3260] successful.
Oct 30 09:49:34 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78b4332-e3cc-4093-8c0a-bfc6c735b09c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d00099-7d46-4264-b718-56064a2614f9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== disconnect_volume: return (278ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:49:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Deleting instance files /opt/stack/data/nova/instances/13d468ad-69a5-409d-b737-188a4f1a7bda_del
Oct 30 09:49:34 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Deletion of /opt/stack/data/nova/instances/13d468ad-69a5-409d-b737-188a4f1a7bda_del complete
Oct 30 09:49:34 user nova-compute[75017]: INFO nova.compute.manager [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 30 09:49:34 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:49:34 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:49:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-893f6a25-ceef-4d58-826b-883aca646f7e req-af883ac3-51e1-4b91-9133-9ed638886796 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received event network-vif-plugged-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:49:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-893f6a25-ceef-4d58-826b-883aca646f7e req-af883ac3-51e1-4b91-9133-9ed638886796 service nova] Acquiring lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-893f6a25-ceef-4d58-826b-883aca646f7e req-af883ac3-51e1-4b91-9133-9ed638886796 service nova] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-893f6a25-ceef-4d58-826b-883aca646f7e req-af883ac3-51e1-4b91-9133-9ed638886796 service nova] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-893f6a25-ceef-4d58-826b-883aca646f7e req-af883ac3-51e1-4b91-9133-9ed638886796 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] No waiting events found dispatching network-vif-plugged-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:49:35 user nova-compute[75017]: WARNING nova.compute.manager [req-893f6a25-ceef-4d58-826b-883aca646f7e req-af883ac3-51e1-4b91-9133-9ed638886796 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received unexpected event network-vif-plugged-1a5e045c-628a-4c84-ba60-dae49f823989 for instance with vm_state active and task_state deleting.
Oct 30 09:49:35 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:49:35 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Took 1.47 seconds to deallocate network for instance.
Oct 30 09:49:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-4d7b267d-d42a-41b0-b192-4a0f2bf5b085 req-a8a4cee3-355b-4e22-94f7-3c06d8ff31f4 service nova] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Received event network-vif-deleted-1a5e045c-628a-4c84-ba60-dae49f823989 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:49:35 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:36 user nova-compute[75017]: INFO nova.compute.manager [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Took 0.80 seconds to detach 1 volumes for instance.
Oct 30 09:49:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 13d468ad-69a5-409d-b737-188a4f1a7bda] Deleting volume: d78b4332-e3cc-4093-8c0a-bfc6c735b09c {{(pid=75017) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 09:49:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:36 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:49:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:49:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:36 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Deleted allocations for instance 13d468ad-69a5-409d-b737-188a4f1a7bda
Oct 30 09:49:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-9844416d-8d75-4615-8d08-5c567d7d512d tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "13d468ad-69a5-409d-b737-188a4f1a7bda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.851s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:38 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:40 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:41 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:49:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:41 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:49:42 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:49:42 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:49:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=24.858062744140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 469c433e-a055-4b0d-a7f1-902cd5b13707 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:49:42 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:49:43 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:49:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:49:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:49:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:49:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:49:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:49:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:49:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:49:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:49:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:50:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:04 user nova-compute[75017]: DEBUG nova.objects.instance [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:50:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquired lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:50:04 user nova-compute[75017]: DEBUG nova.network.neutron [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:50:04 user nova-compute[75017]: DEBUG nova.objects.instance [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'info_cache' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:04 user nova-compute[75017]: DEBUG nova.objects.base [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "469c433e-a055-4b0d-a7f1-902cd5b13707" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:05 user nova-compute[75017]: INFO nova.compute.manager [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Terminating instance
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.compute.manager [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.network.neutron [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating instance_info_cache with network_info: [{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Releasing lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance destroyed successfully.
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.instance [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'resources' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.base [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-344788784',display_name='tempest-AttachVolumeTestJSON-server-344788784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-344788784',id=45,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVTBqkedZ8DJcluIuuSR1Rs15YnzXdFIYJW6MeuRFPLbBpZCGoCobvdV+r75RqCnBFUTK/Ud3FmzSHXRcK299KiuruO2+/ng7MI6WYnIozxCe9mRAg6yA2OJX0E7gzgzg==',key_name='tempest-keypair-1729982551',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-hejj34d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=46c70e09-7d64-4488-b20e-7a8d84ddf0e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG os_vif [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15693dcb-02, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79075d04-390e-4d02-a960-4dcf29bfa6cf) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:05 user nova-compute[75017]: INFO os_vif [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02')
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Start _get_guest_xml network_info=[{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.instance [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'numa_topology' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.base [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-4cc748e0-c197-4c93-9ce9-2dbdce43fff3 req-0cf2657f-e65d-491b-9811-a6e869f5a125 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received event network-vif-unplugged-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4cc748e0-c197-4c93-9ce9-2dbdce43fff3 req-0cf2657f-e65d-491b-9811-a6e869f5a125 service nova] Acquiring lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4cc748e0-c197-4c93-9ce9-2dbdce43fff3 req-0cf2657f-e65d-491b-9811-a6e869f5a125 service nova] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-4cc748e0-c197-4c93-9ce9-2dbdce43fff3 req-0cf2657f-e65d-491b-9811-a6e869f5a125 service nova] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-4cc748e0-c197-4c93-9ce9-2dbdce43fff3 req-0cf2657f-e65d-491b-9811-a6e869f5a125 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] No waiting events found dispatching network-vif-unplugged-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.compute.manager [req-4cc748e0-c197-4c93-9ce9-2dbdce43fff3 req-0cf2657f-e65d-491b-9811-a6e869f5a125 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received event network-vif-unplugged-201bcf26-47d6-4832-a32b-1caf784b524c for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:50:05 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:50:05 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.instance [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'vcpu_model' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.base [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-344788784',display_name='tempest-AttachVolumeTestJSON-server-344788784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-344788784',id=45,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVTBqkedZ8DJcluIuuSR1Rs15YnzXdFIYJW6MeuRFPLbBpZCGoCobvdV+r75RqCnBFUTK/Ud3FmzSHXRcK299KiuruO2+/ng7MI6WYnIozxCe9mRAg6yA2OJX0E7gzgzg==',key_name='tempest-keypair-1729982551',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-hejj34d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=46c70e09-7d64-4488-b20e-7a8d84ddf0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.instance [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'pci_devices' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.base [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:50:05 user nova-compute[75017]:   <uuid>46c70e09-7d64-4488-b20e-7a8d84ddf0e6</uuid>
Oct 30 09:50:05 user nova-compute[75017]:   <name>instance-0000002d</name>
Oct 30 09:50:05 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:50:05 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:50:05 user nova-compute[75017]:   <metadata>
Oct 30 09:50:05 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:50:05 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:50:05 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeTestJSON-server-344788784</nova:name>
Oct 30 09:50:05 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:50:05</nova:creationTime>
Oct 30 09:50:05 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:50:05 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:50:05 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:50:05 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:50:05 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:50:05 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:50:05 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:50:05 user nova-compute[75017]:       <nova:owner>
Oct 30 09:50:05 user nova-compute[75017]:         <nova:user uuid="0fda3d7725f8465097f0ef2b1abb1989">tempest-AttachVolumeTestJSON-1415373227-project-member</nova:user>
Oct 30 09:50:05 user nova-compute[75017]:         <nova:project uuid="244a9d4d205d46aa86afe4c739d11557">tempest-AttachVolumeTestJSON-1415373227</nova:project>
Oct 30 09:50:05 user nova-compute[75017]:       </nova:owner>
Oct 30 09:50:05 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:50:05 user nova-compute[75017]:       <nova:ports>
Oct 30 09:50:05 user nova-compute[75017]:         <nova:port uuid="15693dcb-0226-45db-8c67-3a72a18d89b1">
Oct 30 09:50:05 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 09:50:05 user nova-compute[75017]:         </nova:port>
Oct 30 09:50:05 user nova-compute[75017]:       </nova:ports>
Oct 30 09:50:05 user nova-compute[75017]:     </nova:instance>
Oct 30 09:50:05 user nova-compute[75017]:   </metadata>
Oct 30 09:50:05 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:50:05 user nova-compute[75017]:     <system>
Oct 30 09:50:05 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:50:05 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:50:05 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:50:05 user nova-compute[75017]:       <entry name="serial">46c70e09-7d64-4488-b20e-7a8d84ddf0e6</entry>
Oct 30 09:50:05 user nova-compute[75017]:       <entry name="uuid">46c70e09-7d64-4488-b20e-7a8d84ddf0e6</entry>
Oct 30 09:50:05 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:50:05 user nova-compute[75017]:     </system>
Oct 30 09:50:05 user nova-compute[75017]:   </sysinfo>
Oct 30 09:50:05 user nova-compute[75017]:   <os>
Oct 30 09:50:05 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:50:05 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:50:05 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:50:05 user nova-compute[75017]:   </os>
Oct 30 09:50:05 user nova-compute[75017]:   <features>
Oct 30 09:50:05 user nova-compute[75017]:     <acpi/>
Oct 30 09:50:05 user nova-compute[75017]:     <apic/>
Oct 30 09:50:05 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:50:05 user nova-compute[75017]:   </features>
Oct 30 09:50:05 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:50:05 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:50:05 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:50:05 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:50:05 user nova-compute[75017]:   </clock>
Oct 30 09:50:05 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:50:05 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:50:05 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:50:05 user nova-compute[75017]:   </cpu>
Oct 30 09:50:05 user nova-compute[75017]:   <devices>
Oct 30 09:50:05 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:50:05 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:50:05 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk"/>
Oct 30 09:50:05 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:50:05 user nova-compute[75017]:     </disk>
Oct 30 09:50:05 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:50:05 user nova-compute[75017]:       <mac address="fa:16:3e:4e:b7:ce"/>
Oct 30 09:50:05 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:50:05 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:50:05 user nova-compute[75017]:       <target dev="tap15693dcb-02"/>
Oct 30 09:50:05 user nova-compute[75017]:     </interface>
Oct 30 09:50:05 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:50:05 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/console.log" append="off"/>
Oct 30 09:50:05 user nova-compute[75017]:     </serial>
Oct 30 09:50:05 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:50:05 user nova-compute[75017]:     <video>
Oct 30 09:50:05 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:50:05 user nova-compute[75017]:     </video>
Oct 30 09:50:05 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:50:05 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:50:05 user nova-compute[75017]:     </rng>
Oct 30 09:50:05 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:50:05 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:50:05 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:50:05 user nova-compute[75017]:     </memballoon>
Oct 30 09:50:05 user nova-compute[75017]:   </devices>
Oct 30 09:50:05 user nova-compute[75017]: </domain>
Oct 30 09:50:05 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.instance [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'trusted_certs' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG nova.objects.base [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:50:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Instance destroyed successfully.
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.objects.instance [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lazy-loading 'resources' on Instance uuid 469c433e-a055-4b0d-a7f1-902cd5b13707 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1235203410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1235203410',id=35,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ba6409f82447ba9d0f4f56eef88b1d',ramdisk_id='',reservation_id='r-1qgvs0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:31:36Z,user_data=None,user_id='d734d26551bc41a585d443a24fac0cd8',uuid=469c433e-a055-4b0d-a7f1-902cd5b13707,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converting VIF {"id": "201bcf26-47d6-4832-a32b-1caf784b524c", "address": "fa:16:3e:35:a6:8f", "network": {"id": "f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-90890013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ba6409f82447ba9d0f4f56eef88b1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201bcf26-47", "ovs_interfaceid": "201bcf26-47d6-4832-a32b-1caf784b524c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:a6:8f,bridge_name='br-int',has_traffic_filtering=True,id=201bcf26-47d6-4832-a32b-1caf784b524c,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201bcf26-47') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG os_vif [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:a6:8f,bridge_name='br-int',has_traffic_filtering=True,id=201bcf26-47d6-4832-a32b-1caf784b524c,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201bcf26-47') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap201bcf26-47, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5dbe63e-7af4-4007-82b8-020ca56ccaec) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:50:06 user nova-compute[75017]: INFO os_vif [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:a6:8f,bridge_name='br-int',has_traffic_filtering=True,id=201bcf26-47d6-4832-a32b-1caf784b524c,network=Network(f6c5aa2d-b07e-43b8-8ab3-d447be1f9b7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201bcf26-47')
Oct 30 09:50:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Deleting instance files /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707_del
Oct 30 09:50:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Deletion of /opt/stack/data/nova/instances/469c433e-a055-4b0d-a7f1-902cd5b13707_del complete
Oct 30 09:50:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:06 user nova-compute[75017]: INFO nova.compute.manager [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 30 09:50:06 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Cannot resize image /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.objects.instance [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'migration_context' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.objects.base [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Object Instance<46c70e09-7d64-4488-b20e-7a8d84ddf0e6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75017) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-344788784',display_name='tempest-AttachVolumeTestJSON-server-344788784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-344788784',id=45,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVTBqkedZ8DJcluIuuSR1Rs15YnzXdFIYJW6MeuRFPLbBpZCGoCobvdV+r75RqCnBFUTK/Ud3FmzSHXRcK299KiuruO2+/ng7MI6WYnIozxCe9mRAg6yA2OJX0E7gzgzg==',key_name='tempest-keypair-1729982551',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-hejj34d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=46c70e09-7d64-4488-b20e-7a8d84ddf0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG os_vif [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c2ee34a-0597-58cf-88de-aa053cc03702', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15693dcb-02, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15693dcb-02, col_values=(('qos', UUID('5f2629fa-3914-4d2f-bb95-059b3da841b9')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15693dcb-02, col_values=(('external_ids', {'iface-id': '15693dcb-0226-45db-8c67-3a72a18d89b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:b7:ce', 'vm-uuid': '46c70e09-7d64-4488-b20e-7a8d84ddf0e6'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:50:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:06 user nova-compute[75017]: INFO os_vif [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02')
Oct 30 09:50:07 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:50:07 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Took 1.21 seconds to deallocate network for instance.
Oct 30 09:50:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-72692134-0a52-41a2-bc62-97c4c8c8c7f8 req-f02965f9-b82f-48e2-8a38-ee367ac2a5a8 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received event network-vif-plugged-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-72692134-0a52-41a2-bc62-97c4c8c8c7f8 req-f02965f9-b82f-48e2-8a38-ee367ac2a5a8 service nova] Acquiring lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-72692134-0a52-41a2-bc62-97c4c8c8c7f8 req-f02965f9-b82f-48e2-8a38-ee367ac2a5a8 service nova] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-72692134-0a52-41a2-bc62-97c4c8c8c7f8 req-f02965f9-b82f-48e2-8a38-ee367ac2a5a8 service nova] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-72692134-0a52-41a2-bc62-97c4c8c8c7f8 req-f02965f9-b82f-48e2-8a38-ee367ac2a5a8 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] No waiting events found dispatching network-vif-plugged-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:50:07 user nova-compute[75017]: WARNING nova.compute.manager [req-72692134-0a52-41a2-bc62-97c4c8c8c7f8 req-f02965f9-b82f-48e2-8a38-ee367ac2a5a8 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received unexpected event network-vif-plugged-201bcf26-47d6-4832-a32b-1caf784b524c for instance with vm_state deleted and task_state None.
Oct 30 09:50:07 user nova-compute[75017]: DEBUG nova.compute.manager [req-72692134-0a52-41a2-bc62-97c4c8c8c7f8 req-f02965f9-b82f-48e2-8a38-ee367ac2a5a8 service nova] [instance: 469c433e-a055-4b0d-a7f1-902cd5b13707] Received event network-vif-deleted-201bcf26-47d6-4832-a32b-1caf784b524c {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:07 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Deleted allocations for instance 469c433e-a055-4b0d-a7f1-902cd5b13707
Oct 30 09:50:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-ee541802-952d-42c1-92d3-0df34bb39e40 tempest-ServerBootFromVolumeStableRescueTest-1506388181 tempest-ServerBootFromVolumeStableRescueTest-1506388181-project-member] Lock "469c433e-a055-4b0d-a7f1-902cd5b13707" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.534s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:08 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:50:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:50:09 user nova-compute[75017]: WARNING nova.compute.manager [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state powering-on.
Oct 30 09:50:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:50:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:09 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:09 user nova-compute[75017]: DEBUG nova.compute.manager [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:50:09 user nova-compute[75017]: WARNING nova.compute.manager [req-9f258ee4-c59b-45ea-93d1-ad52a1e664e6 req-48906687-3db7-4036-861b-46420a67dc53 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state stopped and task_state powering-on.
Oct 30 09:50:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:50:09 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance rebooted successfully.
Oct 30 09:50:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-febe474f-ae54-4836-9f11-9ec5fd927b90 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:50:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:23 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:36 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "273a7b1c-51ca-4451-9122-2e8b611db2c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:50:42 user nova-compute[75017]: INFO nova.compute.claims [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Claim successful on node user
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:50:42 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:50:42 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG nova.policy [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd23876ced14c21a33d3c13100323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7428fb3055ac4e39b8e00760816b5bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:50:42 user nova-compute[75017]: INFO nova.virt.block_device [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Booting with volume 6258ecf2-8662-4fd7-be2d-8cb8032a378b at /dev/vda
Oct 30 09:50:42 user nova-compute[75017]: DEBUG os_brick.utils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4205c5-4e79-4eea-b29c-2e8e55e2a89c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2093af9b-80be-4118-9f13-4d92894142aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:50:42 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d6d4fb-43c4-418f-bfeb-44d4e20afbb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1a79ef-350a-49a2-b847-d10bb163119f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:50:43 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a969c7-c660-49da-b297-0a99b9b7475b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG os_brick.utils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Updating existing volume attachment record: 7a718cdd-c89d-4237-bb66-8c86f70540f9 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Successfully created port: 60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:50:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Successfully updated port: 60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-8cc56a03-5ff4-4873-be60-c1db64a43df5 req-df0f29af-8e7a-45ee-a3fe-d13e6c6c1138 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received event network-changed-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.manager [req-8cc56a03-5ff4-4873-be60-c1db64a43df5 req-df0f29af-8e7a-45ee-a3fe-d13e6c6c1138 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Refreshing instance network info cache due to event network-changed-60f2abdf-2834-476e-a922-d11e203cd60d. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8cc56a03-5ff4-4873-be60-c1db64a43df5 req-df0f29af-8e7a-45ee-a3fe-d13e6c6c1138 service nova] Acquiring lock "refresh_cache-273a7b1c-51ca-4451-9122-2e8b611db2c5" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8cc56a03-5ff4-4873-be60-c1db64a43df5 req-df0f29af-8e7a-45ee-a3fe-d13e6c6c1138 service nova] Acquired lock "refresh_cache-273a7b1c-51ca-4451-9122-2e8b611db2c5" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.network.neutron [req-8cc56a03-5ff4-4873-be60-c1db64a43df5 req-df0f29af-8e7a-45ee-a3fe-d13e6c6c1138 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Refreshing network info cache for port 60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "refresh_cache-273a7b1c-51ca-4451-9122-2e8b611db2c5" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:50:44 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:50:44 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=24.972858428955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.network.neutron [req-8cc56a03-5ff4-4873-be60-c1db64a43df5 req-df0f29af-8e7a-45ee-a3fe-d13e6c6c1138 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 273a7b1c-51ca-4451-9122-2e8b611db2c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.network.neutron [req-8cc56a03-5ff4-4873-be60-c1db64a43df5 req-df0f29af-8e7a-45ee-a3fe-d13e6c6c1138 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8cc56a03-5ff4-4873-be60-c1db64a43df5 req-df0f29af-8e7a-45ee-a3fe-d13e6c6c1138 service nova] Releasing lock "refresh_cache-273a7b1c-51ca-4451-9122-2e8b611db2c5" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquired lock "refresh_cache-273a7b1c-51ca-4451-9122-2e8b611db2c5" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.network.neutron [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Updating instance_info_cache with network_info: [{"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Releasing lock "refresh_cache-273a7b1c-51ca-4451-9122-2e8b611db2c5" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:50:44 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Instance network_info: |[{"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:50:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:46 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:50:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:50:46 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Skipping network cache update for instance because it is Building. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 30 09:50:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:50:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:50:46 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:50:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:50:47 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating instance_info_cache with network_info: [{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:50:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:50:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:50:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:50:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:55 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:50:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:50:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:50:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:50:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:50:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:50:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:51:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:51:00 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Creating image(s)
Oct 30 09:51:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:51:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Ensure instance console log exists: /opt/stack/data/nova/instances/273a7b1c-51ca-4451-9122-2e8b611db2c5/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:51:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Start _get_guest_xml network_info=[{"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjFQlRnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '273a7b1c-51ca-4451-9122-2e8b611db2c5', 'attached_at': '', 'detached_at': '', 'volume_id': '6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'serial': '6258ecf2-8662-4fd7-be2d-8cb8032a378b'}, 'disk_bus': 'virtio', 'attachment_id': '7a718cdd-c89d-4237-bb66-8c86f70540f9', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:51:00 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:51:00 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:51:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjFQlRnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:51:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:51:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:51:01 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f5c8a9-a279-4908-a229-2d1c261648f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:51:01 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[382078be-e935-44d2-9003-128467350e03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b] added
Oct 30 09:51:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaa7476-699f-482e-926e-12ae4254835d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[01915824-ac29-49bb-bfb0-c7f1e73dbe90]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjFQlRnD {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjFQlRnD" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1998ac-7a94-4cdb-b569-218bd319f591]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjFQlRnD'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[13931e3b-3961-42af-84fd-1b83b508b91c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cef8d2-24ba-421a-982c-77cf79a3390c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 09:51:01 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 09:51:01 user nova-compute[75017]:  {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:51:01 user nova-compute[75017]: WARNING os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 09:51:01 user nova-compute[75017]: 
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[35738845-8255-45b3-85e3-9efd36197fc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260]
Oct 30 09:51:01 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260] successful.
Oct 30 09:51:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa7fc87-dfef-4a5b-9256-0bae3bfe844a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1189ec9c-fd4c-4d2d-8355-e915018e726a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:51:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:51:01 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcfe450-2f09-4d96-8a01-f8ec144475e3]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:51:01 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjFQlRnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23065393138373065', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065393138373065', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-17552917',display_name='tempest-TestVolumeBootPattern-server-17552917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-17552917',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsUM189Gj4ZQK8ktc4SfL8GV9WmFPbk65gikfbzax6I4b+Q5HAfpYeqLFZ+I6kJcsujAtPVcto1HAkVmN3/yY4HzAGCLDwxyvqr2x0TZvxr9uVlQnXJ0b4+bg5qwFMY/Q==',key_name='tempest-TestVolumeBootPattern-238078442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-ooqhru12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:50:43Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=273a7b1c-51ca-4451-9122-2e8b611db2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:b3,bridge_name='br-int',has_traffic_filtering=True,id=60f2abdf-2834-476e-a922-d11e203cd60d,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2abdf-28') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.objects.instance [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'pci_devices' on Instance uuid 273a7b1c-51ca-4451-9122-2e8b611db2c5 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:51:02 user nova-compute[75017]:   <uuid>273a7b1c-51ca-4451-9122-2e8b611db2c5</uuid>
Oct 30 09:51:02 user nova-compute[75017]:   <name>instance-00000031</name>
Oct 30 09:51:02 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:51:02 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:51:02 user nova-compute[75017]:   <metadata>
Oct 30 09:51:02 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:51:02 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:51:02 user nova-compute[75017]:       <nova:name>tempest-TestVolumeBootPattern-server-17552917</nova:name>
Oct 30 09:51:02 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:51:00</nova:creationTime>
Oct 30 09:51:02 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:51:02 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:51:02 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:51:02 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:51:02 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:51:02 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:51:02 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:51:02 user nova-compute[75017]:       <nova:owner>
Oct 30 09:51:02 user nova-compute[75017]:         <nova:user uuid="5cd23876ced14c21a33d3c13100323a3">tempest-TestVolumeBootPattern-2136848934-project-member</nova:user>
Oct 30 09:51:02 user nova-compute[75017]:         <nova:project uuid="7428fb3055ac4e39b8e00760816b5bb4">tempest-TestVolumeBootPattern-2136848934</nova:project>
Oct 30 09:51:02 user nova-compute[75017]:       </nova:owner>
Oct 30 09:51:02 user nova-compute[75017]:       <nova:ports>
Oct 30 09:51:02 user nova-compute[75017]:         <nova:port uuid="60f2abdf-2834-476e-a922-d11e203cd60d">
Oct 30 09:51:02 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 09:51:02 user nova-compute[75017]:         </nova:port>
Oct 30 09:51:02 user nova-compute[75017]:       </nova:ports>
Oct 30 09:51:02 user nova-compute[75017]:     </nova:instance>
Oct 30 09:51:02 user nova-compute[75017]:   </metadata>
Oct 30 09:51:02 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:51:02 user nova-compute[75017]:     <system>
Oct 30 09:51:02 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:51:02 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:51:02 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:51:02 user nova-compute[75017]:       <entry name="serial">273a7b1c-51ca-4451-9122-2e8b611db2c5</entry>
Oct 30 09:51:02 user nova-compute[75017]:       <entry name="uuid">273a7b1c-51ca-4451-9122-2e8b611db2c5</entry>
Oct 30 09:51:02 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:51:02 user nova-compute[75017]:     </system>
Oct 30 09:51:02 user nova-compute[75017]:   </sysinfo>
Oct 30 09:51:02 user nova-compute[75017]:   <os>
Oct 30 09:51:02 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:51:02 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:51:02 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:51:02 user nova-compute[75017]:   </os>
Oct 30 09:51:02 user nova-compute[75017]:   <features>
Oct 30 09:51:02 user nova-compute[75017]:     <acpi/>
Oct 30 09:51:02 user nova-compute[75017]:     <apic/>
Oct 30 09:51:02 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:51:02 user nova-compute[75017]:   </features>
Oct 30 09:51:02 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:51:02 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:51:02 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:51:02 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:51:02 user nova-compute[75017]:   </clock>
Oct 30 09:51:02 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:51:02 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:51:02 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:51:02 user nova-compute[75017]:   </cpu>
Oct 30 09:51:02 user nova-compute[75017]:   <devices>
Oct 30 09:51:02 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:51:02 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:51:02 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:51:02 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:51:02 user nova-compute[75017]:       <serial>6258ecf2-8662-4fd7-be2d-8cb8032a378b</serial>
Oct 30 09:51:02 user nova-compute[75017]:     </disk>
Oct 30 09:51:02 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:51:02 user nova-compute[75017]:       <mac address="fa:16:3e:44:40:b3"/>
Oct 30 09:51:02 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:51:02 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:51:02 user nova-compute[75017]:       <target dev="tap60f2abdf-28"/>
Oct 30 09:51:02 user nova-compute[75017]:     </interface>
Oct 30 09:51:02 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:51:02 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/273a7b1c-51ca-4451-9122-2e8b611db2c5/console.log" append="off"/>
Oct 30 09:51:02 user nova-compute[75017]:     </serial>
Oct 30 09:51:02 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:51:02 user nova-compute[75017]:     <video>
Oct 30 09:51:02 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:51:02 user nova-compute[75017]:     </video>
Oct 30 09:51:02 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:51:02 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:51:02 user nova-compute[75017]:     </rng>
Oct 30 09:51:02 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:51:02 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:51:02 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:51:02 user nova-compute[75017]:     </memballoon>
Oct 30 09:51:02 user nova-compute[75017]:   </devices>
Oct 30 09:51:02 user nova-compute[75017]: </domain>
Oct 30 09:51:02 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-17552917',display_name='tempest-TestVolumeBootPattern-server-17552917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-17552917',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsUM189Gj4ZQK8ktc4SfL8GV9WmFPbk65gikfbzax6I4b+Q5HAfpYeqLFZ+I6kJcsujAtPVcto1HAkVmN3/yY4HzAGCLDwxyvqr2x0TZvxr9uVlQnXJ0b4+bg5qwFMY/Q==',key_name='tempest-TestVolumeBootPattern-238078442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-ooqhru12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:50:43Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=273a7b1c-51ca-4451-9122-2e8b611db2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:b3,bridge_name='br-int',has_traffic_filtering=True,id=60f2abdf-2834-476e-a922-d11e203cd60d,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2abdf-28') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG os_vif [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:b3,bridge_name='br-int',has_traffic_filtering=True,id=60f2abdf-2834-476e-a922-d11e203cd60d,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2abdf-28') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5769144-5ce5-5365-9269-02db9b2c9209', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f2abdf-28, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60f2abdf-28, col_values=(('qos', UUID('fa03f949-ce47-4687-b2f1-74364503ff4c')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60f2abdf-28, col_values=(('external_ids', {'iface-id': '60f2abdf-2834-476e-a922-d11e203cd60d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:40:b3', 'vm-uuid': '273a7b1c-51ca-4451-9122-2e8b611db2c5'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:02 user nova-compute[75017]: INFO os_vif [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:b3,bridge_name='br-int',has_traffic_filtering=True,id=60f2abdf-2834-476e-a922-d11e203cd60d,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2abdf-28')
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:51:02 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No VIF found with MAC fa:16:3e:44:40:b3, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:51:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:03 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-39f7b4c1-22bd-4be3-9167-abedb561037d req-afb0aa34-e198-477b-b3bf-0755b0e53493 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received event network-vif-plugged-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:51:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-39f7b4c1-22bd-4be3-9167-abedb561037d req-afb0aa34-e198-477b-b3bf-0755b0e53493 service nova] Acquiring lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-39f7b4c1-22bd-4be3-9167-abedb561037d req-afb0aa34-e198-477b-b3bf-0755b0e53493 service nova] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:04 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-39f7b4c1-22bd-4be3-9167-abedb561037d req-afb0aa34-e198-477b-b3bf-0755b0e53493 service nova] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:04 user nova-compute[75017]: DEBUG nova.compute.manager [req-39f7b4c1-22bd-4be3-9167-abedb561037d req-afb0aa34-e198-477b-b3bf-0755b0e53493 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] No waiting events found dispatching network-vif-plugged-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:51:04 user nova-compute[75017]: WARNING nova.compute.manager [req-39f7b4c1-22bd-4be3-9167-abedb561037d req-afb0aa34-e198-477b-b3bf-0755b0e53493 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received unexpected event network-vif-plugged-60f2abdf-2834-476e-a922-d11e203cd60d for instance with vm_state building and task_state spawning.
Oct 30 09:51:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:51:06 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Instance spawned successfully.
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:51:06 user nova-compute[75017]: INFO nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Took 5.34 seconds to spawn the instance on the hypervisor.
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:51:06 user nova-compute[75017]: INFO nova.compute.manager [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Took 23.96 seconds to build instance.
Oct 30 09:51:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-b7c7006c-a8d2-4a16-b750-647cb2e990d2 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.052s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-df85157a-f90f-4904-81be-6bfc72801ceb req-356e48e8-4db6-47ac-9d9f-7f360621b5b9 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received event network-vif-plugged-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-df85157a-f90f-4904-81be-6bfc72801ceb req-356e48e8-4db6-47ac-9d9f-7f360621b5b9 service nova] Acquiring lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-df85157a-f90f-4904-81be-6bfc72801ceb req-356e48e8-4db6-47ac-9d9f-7f360621b5b9 service nova] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-df85157a-f90f-4904-81be-6bfc72801ceb req-356e48e8-4db6-47ac-9d9f-7f360621b5b9 service nova] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:06 user nova-compute[75017]: DEBUG nova.compute.manager [req-df85157a-f90f-4904-81be-6bfc72801ceb req-356e48e8-4db6-47ac-9d9f-7f360621b5b9 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] No waiting events found dispatching network-vif-plugged-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:51:06 user nova-compute[75017]: WARNING nova.compute.manager [req-df85157a-f90f-4904-81be-6bfc72801ceb req-356e48e8-4db6-47ac-9d9f-7f360621b5b9 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received unexpected event network-vif-plugged-60f2abdf-2834-476e-a922-d11e203cd60d for instance with vm_state active and task_state None.
Oct 30 09:51:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:51:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:51:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:51:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:51:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:51:40 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:51:42 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:51:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:51:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:51:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:51:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:51:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:51:43 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:51:44 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:51:44 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:51:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=24.97032928466797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 273a7b1c-51ca-4451-9122-2e8b611db2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:51:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:51:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:51:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:51:47 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:51:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:51:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:51:47 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:51:47 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:51:48 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating instance_info_cache with network_info: [{"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:51:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-46c70e09-7d64-4488-b20e-7a8d84ddf0e6" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:51:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:51:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:51:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:51:52 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:51:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:51:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:56 user nova-compute[75017]: INFO nova.compute.manager [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Terminating instance
Oct 30 09:51:56 user nova-compute[75017]: DEBUG nova.compute.manager [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-8db23654-e983-451d-a0f8-0c91d9c3e6d4 req-90078f57-5491-4dbd-830c-38e20552b0bd service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8db23654-e983-451d-a0f8-0c91d9c3e6d4 req-90078f57-5491-4dbd-830c-38e20552b0bd service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8db23654-e983-451d-a0f8-0c91d9c3e6d4 req-90078f57-5491-4dbd-830c-38e20552b0bd service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8db23654-e983-451d-a0f8-0c91d9c3e6d4 req-90078f57-5491-4dbd-830c-38e20552b0bd service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-8db23654-e983-451d-a0f8-0c91d9c3e6d4 req-90078f57-5491-4dbd-830c-38e20552b0bd service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-8db23654-e983-451d-a0f8-0c91d9c3e6d4 req-90078f57-5491-4dbd-830c-38e20552b0bd service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-unplugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:57 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Instance destroyed successfully.
Oct 30 09:51:57 user nova-compute[75017]: DEBUG nova.objects.instance [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'resources' on Instance uuid 46c70e09-7d64-4488-b20e-7a8d84ddf0e6 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-344788784',display_name='tempest-AttachVolumeTestJSON-server-344788784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-344788784',id=45,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVTBqkedZ8DJcluIuuSR1Rs15YnzXdFIYJW6MeuRFPLbBpZCGoCobvdV+r75RqCnBFUTK/Ud3FmzSHXRcK299KiuruO2+/ng7MI6WYnIozxCe9mRAg6yA2OJX0E7gzgzg==',key_name='tempest-keypair-1729982551',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-hejj34d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=46c70e09-7d64-4488-b20e-7a8d84ddf0e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "15693dcb-0226-45db-8c67-3a72a18d89b1", "address": "fa:16:3e:4e:b7:ce", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15693dcb-02", "ovs_interfaceid": "15693dcb-0226-45db-8c67-3a72a18d89b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG os_vif [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15693dcb-02, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f2629fa-3914-4d2f-bb95-059b3da841b9) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:51:57 user nova-compute[75017]: INFO os_vif [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b7:ce,bridge_name='br-int',has_traffic_filtering=True,id=15693dcb-0226-45db-8c67-3a72a18d89b1,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15693dcb-02')
Oct 30 09:51:57 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Deleting instance files /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6_del
Oct 30 09:51:57 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Deletion of /opt/stack/data/nova/instances/46c70e09-7d64-4488-b20e-7a8d84ddf0e6_del complete
Oct 30 09:51:57 user nova-compute[75017]: INFO nova.compute.manager [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 30 09:51:57 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:51:57 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:51:57 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Took 0.78 seconds to deallocate network for instance.
Oct 30 09:51:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:58 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:51:58 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:51:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:58 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Deleted allocations for instance 46c70e09-7d64-4488-b20e-7a8d84ddf0e6
Oct 30 09:51:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-d5327dde-de55-4e8b-885e-79e0641de225 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-dc656ead-3ba6-4577-8dfc-d7dff0a17383 req-5dd2883c-c28b-4122-8b6e-20f8db5418d3 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:51:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dc656ead-3ba6-4577-8dfc-d7dff0a17383 req-5dd2883c-c28b-4122-8b6e-20f8db5418d3 service nova] Acquiring lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:51:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dc656ead-3ba6-4577-8dfc-d7dff0a17383 req-5dd2883c-c28b-4122-8b6e-20f8db5418d3 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:51:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-dc656ead-3ba6-4577-8dfc-d7dff0a17383 req-5dd2883c-c28b-4122-8b6e-20f8db5418d3 service nova] Lock "46c70e09-7d64-4488-b20e-7a8d84ddf0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:51:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-dc656ead-3ba6-4577-8dfc-d7dff0a17383 req-5dd2883c-c28b-4122-8b6e-20f8db5418d3 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] No waiting events found dispatching network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:51:58 user nova-compute[75017]: WARNING nova.compute.manager [req-dc656ead-3ba6-4577-8dfc-d7dff0a17383 req-5dd2883c-c28b-4122-8b6e-20f8db5418d3 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received unexpected event network-vif-plugged-15693dcb-0226-45db-8c67-3a72a18d89b1 for instance with vm_state deleted and task_state None.
Oct 30 09:51:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-dc656ead-3ba6-4577-8dfc-d7dff0a17383 req-5dd2883c-c28b-4122-8b6e-20f8db5418d3 service nova] [instance: 46c70e09-7d64-4488-b20e-7a8d84ddf0e6] Received event network-vif-deleted-15693dcb-0226-45db-8c67-3a72a18d89b1 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:52:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:52:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:52:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:52:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:52:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:52:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:52:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:52:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:52:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:52:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:52:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:52:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:52:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:52:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-34d04d3b-3b95-40ce-bb08-74bef699f987 req-3c0923d8-5c9b-4a31-82b3-ce5032c3bfec service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received event network-changed-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:52:34 user nova-compute[75017]: DEBUG nova.compute.manager [req-34d04d3b-3b95-40ce-bb08-74bef699f987 req-3c0923d8-5c9b-4a31-82b3-ce5032c3bfec service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Refreshing instance network info cache due to event network-changed-60f2abdf-2834-476e-a922-d11e203cd60d. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:52:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-34d04d3b-3b95-40ce-bb08-74bef699f987 req-3c0923d8-5c9b-4a31-82b3-ce5032c3bfec service nova] Acquiring lock "refresh_cache-273a7b1c-51ca-4451-9122-2e8b611db2c5" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:52:34 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-34d04d3b-3b95-40ce-bb08-74bef699f987 req-3c0923d8-5c9b-4a31-82b3-ce5032c3bfec service nova] Acquired lock "refresh_cache-273a7b1c-51ca-4451-9122-2e8b611db2c5" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:52:34 user nova-compute[75017]: DEBUG nova.network.neutron [req-34d04d3b-3b95-40ce-bb08-74bef699f987 req-3c0923d8-5c9b-4a31-82b3-ce5032c3bfec service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Refreshing network info cache for port 60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.network.neutron [req-34d04d3b-3b95-40ce-bb08-74bef699f987 req-3c0923d8-5c9b-4a31-82b3-ce5032c3bfec service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Updated VIF entry in instance network info cache for port 60f2abdf-2834-476e-a922-d11e203cd60d. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.network.neutron [req-34d04d3b-3b95-40ce-bb08-74bef699f987 req-3c0923d8-5c9b-4a31-82b3-ce5032c3bfec service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Updating instance_info_cache with network_info: [{"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-34d04d3b-3b95-40ce-bb08-74bef699f987 req-3c0923d8-5c9b-4a31-82b3-ce5032c3bfec service nova] Releasing lock "refresh_cache-273a7b1c-51ca-4451-9122-2e8b611db2c5" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "273a7b1c-51ca-4451-9122-2e8b611db2c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:35 user nova-compute[75017]: INFO nova.compute.manager [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Terminating instance
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-37975849-1e87-48a1-a5e8-53e79f285ebb req-ae551b69-147f-488d-95b7-7cf284ba8cf0 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received event network-vif-unplugged-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-37975849-1e87-48a1-a5e8-53e79f285ebb req-ae551b69-147f-488d-95b7-7cf284ba8cf0 service nova] Acquiring lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-37975849-1e87-48a1-a5e8-53e79f285ebb req-ae551b69-147f-488d-95b7-7cf284ba8cf0 service nova] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-37975849-1e87-48a1-a5e8-53e79f285ebb req-ae551b69-147f-488d-95b7-7cf284ba8cf0 service nova] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-37975849-1e87-48a1-a5e8-53e79f285ebb req-ae551b69-147f-488d-95b7-7cf284ba8cf0 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] No waiting events found dispatching network-vif-unplugged-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.compute.manager [req-37975849-1e87-48a1-a5e8-53e79f285ebb req-ae551b69-147f-488d-95b7-7cf284ba8cf0 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received event network-vif-unplugged-60f2abdf-2834-476e-a922-d11e203cd60d for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:52:35 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Instance destroyed successfully.
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.objects.instance [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'resources' on Instance uuid 273a7b1c-51ca-4451-9122-2e8b611db2c5 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-17552917',display_name='tempest-TestVolumeBootPattern-server-17552917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-17552917',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsUM189Gj4ZQK8ktc4SfL8GV9WmFPbk65gikfbzax6I4b+Q5HAfpYeqLFZ+I6kJcsujAtPVcto1HAkVmN3/yY4HzAGCLDwxyvqr2x0TZvxr9uVlQnXJ0b4+bg5qwFMY/Q==',key_name='tempest-TestVolumeBootPattern-238078442',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:51:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-ooqhru12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:51:06Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=273a7b1c-51ca-4451-9122-2e8b611db2c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "60f2abdf-2834-476e-a922-d11e203cd60d", "address": "fa:16:3e:44:40:b3", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2abdf-28", "ovs_interfaceid": "60f2abdf-2834-476e-a922-d11e203cd60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:b3,bridge_name='br-int',has_traffic_filtering=True,id=60f2abdf-2834-476e-a922-d11e203cd60d,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2abdf-28') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:52:35 user nova-compute[75017]: DEBUG os_vif [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:b3,bridge_name='br-int',has_traffic_filtering=True,id=60f2abdf-2834-476e-a922-d11e203cd60d,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2abdf-28') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f2abdf-28, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa03f949-ce47-4687-b2f1-74364503ff4c) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:52:36 user nova-compute[75017]: INFO os_vif [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:b3,bridge_name='br-int',has_traffic_filtering=True,id=60f2abdf-2834-476e-a922-d11e203cd60d,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2abdf-28')
Oct 30 09:52:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjFQlRnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:52:36 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[413f14d7-2078-45cd-aa69-56d12cc8c56a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:52:36 user nova-compute[75017]: No targets found.
Oct 30 09:52:36 user nova-compute[75017]: iSNS:
Oct 30 09:52:36 user nova-compute[75017]: No targets found.
Oct 30 09:52:36 user nova-compute[75017]: STATIC:
Oct 30 09:52:36 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b
Oct 30 09:52:36 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:52:36 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:52:36 user nova-compute[75017]: FIRMWARE:
Oct 30 09:52:36 user nova-compute[75017]: No targets found.
Oct 30 09:52:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:52:36 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:52:36 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c98352-a42e-4c55-95a3-dec23a3c3eeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e35179-033c-4c35-a178-c4e5c6951202]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:52:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:52:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cf0777c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84f3aed-e6b4-4222-8ced-2c9e41b01c91]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e83c1e-90ab-4df6-a954-952702c839e3]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6240553-dbe3-4dee-8dd8-0f10d7cd7192]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5d4632-d208-413e-ad64-ec557c5ecbc6]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23065393138373065', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_42576521', '/dev/disk/by-id/scsi-1SCST_BIO42576521-0e91870e55757a45') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e09cb17-d55a-485e-b11e-dd4e73447b8c]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b458f6c9-4f53-4cc6-a37d-bf8fa9ac0791]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5345b46c-95ce-4cb0-9811-27fefd854ffc]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260]
Oct 30 09:52:36 user nova-compute[75017]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260] successful.
Oct 30 09:52:36 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ba73ab-5678-4cbc-8153-b129abcaba1f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== disconnect_volume: return (289ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:52:36 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Deleting instance files /opt/stack/data/nova/instances/273a7b1c-51ca-4451-9122-2e8b611db2c5_del
Oct 30 09:52:36 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Deletion of /opt/stack/data/nova/instances/273a7b1c-51ca-4451-9122-2e8b611db2c5_del complete
Oct 30 09:52:36 user nova-compute[75017]: INFO nova.compute.manager [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 30 09:52:36 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:52:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-6864c2ae-3172-43be-8d97-bfba21b659b7 req-3fb9bcde-7a62-4a8e-a2e5-72e81ce6f195 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received event network-vif-plugged-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:52:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6864c2ae-3172-43be-8d97-bfba21b659b7 req-3fb9bcde-7a62-4a8e-a2e5-72e81ce6f195 service nova] Acquiring lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6864c2ae-3172-43be-8d97-bfba21b659b7 req-3fb9bcde-7a62-4a8e-a2e5-72e81ce6f195 service nova] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6864c2ae-3172-43be-8d97-bfba21b659b7 req-3fb9bcde-7a62-4a8e-a2e5-72e81ce6f195 service nova] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-6864c2ae-3172-43be-8d97-bfba21b659b7 req-3fb9bcde-7a62-4a8e-a2e5-72e81ce6f195 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] No waiting events found dispatching network-vif-plugged-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:52:37 user nova-compute[75017]: WARNING nova.compute.manager [req-6864c2ae-3172-43be-8d97-bfba21b659b7 req-3fb9bcde-7a62-4a8e-a2e5-72e81ce6f195 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received unexpected event network-vif-plugged-60f2abdf-2834-476e-a922-d11e203cd60d for instance with vm_state active and task_state deleting.
Oct 30 09:52:37 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:52:37 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Took 1.08 seconds to deallocate network for instance.
Oct 30 09:52:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-4ebaed60-0d02-4585-b066-c4f547e34e7f req-4f3a1485-386a-4e51-8a12-2ba0105c0fa2 service nova] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Received event network-vif-deleted-60f2abdf-2834-476e-a922-d11e203cd60d {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:52:38 user nova-compute[75017]: INFO nova.compute.manager [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 273a7b1c-51ca-4451-9122-2e8b611db2c5] Took 0.82 seconds to detach 1 volumes for instance.
Oct 30 09:52:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:38 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:52:38 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:52:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:52:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:38 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Deleted allocations for instance 273a7b1c-51ca-4451-9122-2e8b611db2c5
Oct 30 09:52:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c9b29af-3ec6-4310-87fd-17495360ba01 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "273a7b1c-51ca-4451-9122-2e8b611db2c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.522s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:42 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:52:43 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:52:43 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:52:44 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:52:44 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:52:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=24.995494842529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:52:44 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:52:45 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:52:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:52:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:52:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:52:48 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:52:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:52:50 user nova-compute[75017]: INFO nova.compute.claims [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Claim successful on node user
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.network.neutron [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:52:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:52:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Creating image(s)
Oct 30 09:52:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "/opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "/opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:50 user nova-compute[75017]: DEBUG nova.policy [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fda3d7725f8465097f0ef2b1abb1989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244a9d4d205d46aa86afe4c739d11557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.183s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "efafbd3e35bfea57f8c492884372109a458d1ba1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk 1073741824 {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1,backing_fmt=raw /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk 1073741824" returned: 0 in 0.061s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "efafbd3e35bfea57f8c492884372109a458d1ba1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efafbd3e35bfea57f8c492884372109a458d1ba1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk. size=1073741824 {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG nova.network.neutron [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Successfully created port: d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG nova.virt.disk.api [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Cannot resize image /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk to a smaller size. {{(pid=75017) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Created local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Ensure instance console log exists: /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Successfully updated port: d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquired lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-c5863061-1ff9-47b1-bdbb-458a4a1e7971 req-2326ff34-15b0-4134-96bc-bc7ed0737624 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received event network-changed-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-c5863061-1ff9-47b1-bdbb-458a4a1e7971 req-2326ff34-15b0-4134-96bc-bc7ed0737624 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Refreshing instance network info cache due to event network-changed-d1645501-dc40-42cf-b3d3-29e703593dd3. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c5863061-1ff9-47b1-bdbb-458a4a1e7971 req-2326ff34-15b0-4134-96bc-bc7ed0737624 service nova] Acquiring lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updating instance_info_cache with network_info: [{"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Releasing lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Instance network_info: |[{"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c5863061-1ff9-47b1-bdbb-458a4a1e7971 req-2326ff34-15b0-4134-96bc-bc7ed0737624 service nova] Acquired lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.neutron [req-c5863061-1ff9-47b1-bdbb-458a4a1e7971 req-2326ff34-15b0-4134-96bc-bc7ed0737624 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Refreshing network info cache for port d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Start _get_guest_xml network_info=[{"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'bfd0d0c2-d64f-40a2-8d8e-991cce6f8585'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:52:52 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:52:52 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T09:08:32Z,direct_url=<?>,disk_format='qcow2',id=bfd0d0c2-d64f-40a2-8d8e-991cce6f8585,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a104474ac014eec94f6f21dfd33064b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T09:08:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-311315715',display_name='tempest-AttachVolumeTestJSON-server-311315715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-311315715',id=50,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXFGinCXP0Xq3tuA3Euf95/MoDYYx30L6srKx4HHM1MIFtasPWBLWG+XOrxAzUplLbsq6sJzfjPpYIgFB4Q+YyuVDK/lOYBzFpjHQG/grO32Ikp5ySJpo3kpPBM9ouzlw==',key_name='tempest-keypair-1461531926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-4ncoueru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=c1cb620d-70ba-4198-a9f7-7005e903bd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e8:af,bridge_name='br-int',has_traffic_filtering=True,id=d1645501-dc40-42cf-b3d3-29e703593dd3,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1645501-dc') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.objects.instance [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'pci_devices' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:52:52 user nova-compute[75017]:   <uuid>c1cb620d-70ba-4198-a9f7-7005e903bd6e</uuid>
Oct 30 09:52:52 user nova-compute[75017]:   <name>instance-00000032</name>
Oct 30 09:52:52 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:52:52 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:52:52 user nova-compute[75017]:   <metadata>
Oct 30 09:52:52 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:52:52 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:52:52 user nova-compute[75017]:       <nova:name>tempest-AttachVolumeTestJSON-server-311315715</nova:name>
Oct 30 09:52:52 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:52:52</nova:creationTime>
Oct 30 09:52:52 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:52:52 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:52:52 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:52:52 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:52:52 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:52:52 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:52:52 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:52:52 user nova-compute[75017]:       <nova:owner>
Oct 30 09:52:52 user nova-compute[75017]:         <nova:user uuid="0fda3d7725f8465097f0ef2b1abb1989">tempest-AttachVolumeTestJSON-1415373227-project-member</nova:user>
Oct 30 09:52:52 user nova-compute[75017]:         <nova:project uuid="244a9d4d205d46aa86afe4c739d11557">tempest-AttachVolumeTestJSON-1415373227</nova:project>
Oct 30 09:52:52 user nova-compute[75017]:       </nova:owner>
Oct 30 09:52:52 user nova-compute[75017]:       <nova:root type="image" uuid="bfd0d0c2-d64f-40a2-8d8e-991cce6f8585"/>
Oct 30 09:52:52 user nova-compute[75017]:       <nova:ports>
Oct 30 09:52:52 user nova-compute[75017]:         <nova:port uuid="d1645501-dc40-42cf-b3d3-29e703593dd3">
Oct 30 09:52:52 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 09:52:52 user nova-compute[75017]:         </nova:port>
Oct 30 09:52:52 user nova-compute[75017]:       </nova:ports>
Oct 30 09:52:52 user nova-compute[75017]:     </nova:instance>
Oct 30 09:52:52 user nova-compute[75017]:   </metadata>
Oct 30 09:52:52 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:52:52 user nova-compute[75017]:     <system>
Oct 30 09:52:52 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:52:52 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:52:52 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:52:52 user nova-compute[75017]:       <entry name="serial">c1cb620d-70ba-4198-a9f7-7005e903bd6e</entry>
Oct 30 09:52:52 user nova-compute[75017]:       <entry name="uuid">c1cb620d-70ba-4198-a9f7-7005e903bd6e</entry>
Oct 30 09:52:52 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:52:52 user nova-compute[75017]:     </system>
Oct 30 09:52:52 user nova-compute[75017]:   </sysinfo>
Oct 30 09:52:52 user nova-compute[75017]:   <os>
Oct 30 09:52:52 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:52:52 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:52:52 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:52:52 user nova-compute[75017]:   </os>
Oct 30 09:52:52 user nova-compute[75017]:   <features>
Oct 30 09:52:52 user nova-compute[75017]:     <acpi/>
Oct 30 09:52:52 user nova-compute[75017]:     <apic/>
Oct 30 09:52:52 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:52:52 user nova-compute[75017]:   </features>
Oct 30 09:52:52 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:52:52 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:52:52 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:52:52 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:52:52 user nova-compute[75017]:   </clock>
Oct 30 09:52:52 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:52:52 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:52:52 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:52:52 user nova-compute[75017]:   </cpu>
Oct 30 09:52:52 user nova-compute[75017]:   <devices>
Oct 30 09:52:52 user nova-compute[75017]:     <disk type="file" device="disk">
Oct 30 09:52:52 user nova-compute[75017]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 09:52:52 user nova-compute[75017]:       <source file="/opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk"/>
Oct 30 09:52:52 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:52:52 user nova-compute[75017]:     </disk>
Oct 30 09:52:52 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:52:52 user nova-compute[75017]:       <mac address="fa:16:3e:b5:e8:af"/>
Oct 30 09:52:52 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:52:52 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:52:52 user nova-compute[75017]:       <target dev="tapd1645501-dc"/>
Oct 30 09:52:52 user nova-compute[75017]:     </interface>
Oct 30 09:52:52 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:52:52 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/console.log" append="off"/>
Oct 30 09:52:52 user nova-compute[75017]:     </serial>
Oct 30 09:52:52 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:52:52 user nova-compute[75017]:     <video>
Oct 30 09:52:52 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:52:52 user nova-compute[75017]:     </video>
Oct 30 09:52:52 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:52:52 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:52:52 user nova-compute[75017]:     </rng>
Oct 30 09:52:52 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:52:52 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:52:52 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:52:52 user nova-compute[75017]:     </memballoon>
Oct 30 09:52:52 user nova-compute[75017]:   </devices>
Oct 30 09:52:52 user nova-compute[75017]: </domain>
Oct 30 09:52:52 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-311315715',display_name='tempest-AttachVolumeTestJSON-server-311315715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-311315715',id=50,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXFGinCXP0Xq3tuA3Euf95/MoDYYx30L6srKx4HHM1MIFtasPWBLWG+XOrxAzUplLbsq6sJzfjPpYIgFB4Q+YyuVDK/lOYBzFpjHQG/grO32Ikp5ySJpo3kpPBM9ouzlw==',key_name='tempest-keypair-1461531926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-4ncoueru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=c1cb620d-70ba-4198-a9f7-7005e903bd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e8:af,bridge_name='br-int',has_traffic_filtering=True,id=d1645501-dc40-42cf-b3d3-29e703593dd3,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1645501-dc') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG os_vif [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e8:af,bridge_name='br-int',has_traffic_filtering=True,id=d1645501-dc40-42cf-b3d3-29e703593dd3,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1645501-dc') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8de012d6-088f-50ba-9998-057caa394a8f', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1645501-dc, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1645501-dc, col_values=(('qos', UUID('6858de30-581a-4d75-b87c-5b47d44bee2b')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1645501-dc, col_values=(('external_ids', {'iface-id': 'd1645501-dc40-42cf-b3d3-29e703593dd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:e8:af', 'vm-uuid': 'c1cb620d-70ba-4198-a9f7-7005e903bd6e'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:52 user nova-compute[75017]: INFO os_vif [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e8:af,bridge_name='br-int',has_traffic_filtering=True,id=d1645501-dc40-42cf-b3d3-29e703593dd3,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1645501-dc')
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No VIF found with MAC fa:16:3e:b5:e8:af, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.neutron [req-c5863061-1ff9-47b1-bdbb-458a4a1e7971 req-2326ff34-15b0-4134-96bc-bc7ed0737624 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updated VIF entry in instance network info cache for port d1645501-dc40-42cf-b3d3-29e703593dd3. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG nova.network.neutron [req-c5863061-1ff9-47b1-bdbb-458a4a1e7971 req-2326ff34-15b0-4134-96bc-bc7ed0737624 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updating instance_info_cache with network_info: [{"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:52:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c5863061-1ff9-47b1-bdbb-458a4a1e7971 req-2326ff34-15b0-4134-96bc-bc7ed0737624 service nova] Releasing lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:52:53 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:52:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:52:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-2c5c753f-d83c-4905-8995-c475cc916da4 req-09794be5-07c1-4830-946b-aa1275fb7583 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received event network-vif-plugged-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:52:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2c5c753f-d83c-4905-8995-c475cc916da4 req-09794be5-07c1-4830-946b-aa1275fb7583 service nova] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2c5c753f-d83c-4905-8995-c475cc916da4 req-09794be5-07c1-4830-946b-aa1275fb7583 service nova] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:54 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-2c5c753f-d83c-4905-8995-c475cc916da4 req-09794be5-07c1-4830-946b-aa1275fb7583 service nova] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:54 user nova-compute[75017]: DEBUG nova.compute.manager [req-2c5c753f-d83c-4905-8995-c475cc916da4 req-09794be5-07c1-4830-946b-aa1275fb7583 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] No waiting events found dispatching network-vif-plugged-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:52:54 user nova-compute[75017]: WARNING nova.compute.manager [req-2c5c753f-d83c-4905-8995-c475cc916da4 req-09794be5-07c1-4830-946b-aa1275fb7583 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received unexpected event network-vif-plugged-d1645501-dc40-42cf-b3d3-29e703593dd3 for instance with vm_state building and task_state spawning.
Oct 30 09:52:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:52:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:52:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Instance spawned successfully.
Oct 30 09:52:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:52:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:52:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:52:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:52:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:52:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:52:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:52:56 user nova-compute[75017]: INFO nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 30 09:52:56 user nova-compute[75017]: DEBUG nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:52:56 user nova-compute[75017]: INFO nova.compute.manager [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Took 5.78 seconds to build instance.
Oct 30 09:52:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-31e33e83-2d2c-4e10-a1eb-855b8673c156 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.874s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-ae2160f3-8a20-4955-8114-d428aa0ec41a req-917722b8-c374-4d8a-91c3-1f5a57d76604 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received event network-vif-plugged-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:52:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ae2160f3-8a20-4955-8114-d428aa0ec41a req-917722b8-c374-4d8a-91c3-1f5a57d76604 service nova] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:52:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ae2160f3-8a20-4955-8114-d428aa0ec41a req-917722b8-c374-4d8a-91c3-1f5a57d76604 service nova] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:52:56 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ae2160f3-8a20-4955-8114-d428aa0ec41a req-917722b8-c374-4d8a-91c3-1f5a57d76604 service nova] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:52:56 user nova-compute[75017]: DEBUG nova.compute.manager [req-ae2160f3-8a20-4955-8114-d428aa0ec41a req-917722b8-c374-4d8a-91c3-1f5a57d76604 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] No waiting events found dispatching network-vif-plugged-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:52:56 user nova-compute[75017]: WARNING nova.compute.manager [req-ae2160f3-8a20-4955-8114-d428aa0ec41a req-917722b8-c374-4d8a-91c3-1f5a57d76604 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received unexpected event network-vif-plugged-d1645501-dc40-42cf-b3d3-29e703593dd3 for instance with vm_state active and task_state None.
Oct 30 09:52:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:52:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:00 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:53:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:53:26 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:53:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:53:26 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:53:26 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:53:26 user nova-compute[75017]: INFO nova.compute.claims [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Claim successful on node user
Oct 30 09:53:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:53:27 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:53:27 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG nova.policy [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd23876ced14c21a33d3c13100323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7428fb3055ac4e39b8e00760816b5bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:53:27 user nova-compute[75017]: INFO nova.virt.block_device [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Booting with volume 6258ecf2-8662-4fd7-be2d-8cb8032a378b at /dev/vda
Oct 30 09:53:27 user nova-compute[75017]: DEBUG os_brick.utils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b31e0f-228e-49ff-9365-96846372ea29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcafef3-ee36-47d6-90b5-71bc3a6f4c6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb63ad1-1ef6-4986-8da4-31f9aa60919c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[301e8464-bf60-46b6-92aa-2576d04e99bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:53:27 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:53:27 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b637c6-3e3f-4110-aeb3-0a8c4476ca2c]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG os_brick.utils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updating existing volume attachment record: 85eee573-0cb4-4f2a-a9ac-b8a5d926dde2 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:27 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Successfully created port: 7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Successfully updated port: 7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquired lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-11d8d600-0d9f-4c03-bdf0-9065ed52c8cf req-0d12fad8-6b14-48fa-a578-c6b9abd92450 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received event network-changed-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-11d8d600-0d9f-4c03-bdf0-9065ed52c8cf req-0d12fad8-6b14-48fa-a578-c6b9abd92450 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Refreshing instance network info cache due to event network-changed-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-11d8d600-0d9f-4c03-bdf0-9065ed52c8cf req-0d12fad8-6b14-48fa-a578-c6b9abd92450 service nova] Acquiring lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG nova.network.neutron [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updating instance_info_cache with network_info: [{"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Releasing lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Instance network_info: |[{"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-11d8d600-0d9f-4c03-bdf0-9065ed52c8cf req-0d12fad8-6b14-48fa-a578-c6b9abd92450 service nova] Acquired lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:53:28 user nova-compute[75017]: DEBUG nova.network.neutron [req-11d8d600-0d9f-4c03-bdf0-9065ed52c8cf req-0d12fad8-6b14-48fa-a578-c6b9abd92450 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Refreshing network info cache for port 7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:53:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-11d8d600-0d9f-4c03-bdf0-9065ed52c8cf req-0d12fad8-6b14-48fa-a578-c6b9abd92450 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updated VIF entry in instance network info cache for port 7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:53:29 user nova-compute[75017]: DEBUG nova.network.neutron [req-11d8d600-0d9f-4c03-bdf0-9065ed52c8cf req-0d12fad8-6b14-48fa-a578-c6b9abd92450 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updating instance_info_cache with network_info: [{"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:53:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-11d8d600-0d9f-4c03-bdf0-9065ed52c8cf req-0d12fad8-6b14-48fa-a578-c6b9abd92450 service nova] Releasing lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:53:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:53:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:53:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:43 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:44 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:44 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:53:45 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Creating image(s)
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Ensure instance console log exists: /opt/stack/data/nova/instances/4e5fc100-7e6f-4dbc-8bbf-12fe983fc479/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Start _get_guest_xml network_info=[{"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjFQlRnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4e5fc100-7e6f-4dbc-8bbf-12fe983fc479', 'attached_at': '', 'detached_at': '', 'volume_id': '6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'serial': '6258ecf2-8662-4fd7-be2d-8cb8032a378b'}, 'disk_bus': 'virtio', 'attachment_id': '85eee573-0cb4-4f2a-a9ac-b8a5d926dde2', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:53:45 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:53:45 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjFQlRnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:53:45 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:53:45 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:53:45 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[71271430-4ddd-4959-a9fa-c6ffd35e0883]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:53:45 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73c6cd7-07f2-4f98-baaf-312519dfbd2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b] added
Oct 30 09:53:45 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa4a41-fbb8-45ca-90ad-bc9237205431]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a771f64-d403-4935-ad10-43c21ccec41a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjFQlRnD {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjFQlRnD" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7782ab-a6b9-4b28-beb3-150c4c38a622]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjFQlRnD'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d1c7c8-8cce-462d-b175-c74939a72d62]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[071c2cd7-25e6-4282-84f3-a2a1ab45be1e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 09:53:45 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 09:53:45 user nova-compute[75017]:  {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:53:45 user nova-compute[75017]: WARNING os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 09:53:45 user nova-compute[75017]: 
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a44fd6-50bd-41f2-a0b8-e9a4b826c8d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260]
Oct 30 09:53:45 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260] successful.
Oct 30 09:53:45 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c339b1b4-5aca-4d18-8625-bdd81bc61f93]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d82390b-84eb-40c8-886a-34af5ce07138]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:53:45 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:53:45 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d288689f-3eb2-4e9c-a861-095e51587433]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjFQlRnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:53:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:53:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:53:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=24.965274810791016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c1cb620d-70ba-4198-a9f7-7005e903bd6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23065393138373065', 'path': '/dev/sdb'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065393138373065', 'path': '/dev/sdb'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:53:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1184143110',display_name='tempest-TestVolumeBootPattern-server-1184143110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1184143110',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsUM189Gj4ZQK8ktc4SfL8GV9WmFPbk65gikfbzax6I4b+Q5HAfpYeqLFZ+I6kJcsujAtPVcto1HAkVmN3/yY4HzAGCLDwxyvqr2x0TZvxr9uVlQnXJ0b4+bg5qwFMY/Q==',key_name='tempest-TestVolumeBootPattern-238078442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-ww7hxscy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:53:27Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=4e5fc100-7e6f-4dbc-8bbf-12fe983fc479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:29:34,bridge_name='br-int',has_traffic_filtering=True,id=7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe6cfd7-17') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:53:46 user nova-compute[75017]:   <uuid>4e5fc100-7e6f-4dbc-8bbf-12fe983fc479</uuid>
Oct 30 09:53:46 user nova-compute[75017]:   <name>instance-00000033</name>
Oct 30 09:53:46 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:53:46 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:53:46 user nova-compute[75017]:   <metadata>
Oct 30 09:53:46 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:53:46 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:53:46 user nova-compute[75017]:       <nova:name>tempest-TestVolumeBootPattern-server-1184143110</nova:name>
Oct 30 09:53:46 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:53:45</nova:creationTime>
Oct 30 09:53:46 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:53:46 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:53:46 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:53:46 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:53:46 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:53:46 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:53:46 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:53:46 user nova-compute[75017]:       <nova:owner>
Oct 30 09:53:46 user nova-compute[75017]:         <nova:user uuid="5cd23876ced14c21a33d3c13100323a3">tempest-TestVolumeBootPattern-2136848934-project-member</nova:user>
Oct 30 09:53:46 user nova-compute[75017]:         <nova:project uuid="7428fb3055ac4e39b8e00760816b5bb4">tempest-TestVolumeBootPattern-2136848934</nova:project>
Oct 30 09:53:46 user nova-compute[75017]:       </nova:owner>
Oct 30 09:53:46 user nova-compute[75017]:       <nova:ports>
Oct 30 09:53:46 user nova-compute[75017]:         <nova:port uuid="7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb">
Oct 30 09:53:46 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 09:53:46 user nova-compute[75017]:         </nova:port>
Oct 30 09:53:46 user nova-compute[75017]:       </nova:ports>
Oct 30 09:53:46 user nova-compute[75017]:     </nova:instance>
Oct 30 09:53:46 user nova-compute[75017]:   </metadata>
Oct 30 09:53:46 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:53:46 user nova-compute[75017]:     <system>
Oct 30 09:53:46 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:53:46 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:53:46 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:53:46 user nova-compute[75017]:       <entry name="serial">4e5fc100-7e6f-4dbc-8bbf-12fe983fc479</entry>
Oct 30 09:53:46 user nova-compute[75017]:       <entry name="uuid">4e5fc100-7e6f-4dbc-8bbf-12fe983fc479</entry>
Oct 30 09:53:46 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:53:46 user nova-compute[75017]:     </system>
Oct 30 09:53:46 user nova-compute[75017]:   </sysinfo>
Oct 30 09:53:46 user nova-compute[75017]:   <os>
Oct 30 09:53:46 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:53:46 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:53:46 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:53:46 user nova-compute[75017]:   </os>
Oct 30 09:53:46 user nova-compute[75017]:   <features>
Oct 30 09:53:46 user nova-compute[75017]:     <acpi/>
Oct 30 09:53:46 user nova-compute[75017]:     <apic/>
Oct 30 09:53:46 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:53:46 user nova-compute[75017]:   </features>
Oct 30 09:53:46 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:53:46 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:53:46 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:53:46 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:53:46 user nova-compute[75017]:   </clock>
Oct 30 09:53:46 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:53:46 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:53:46 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:53:46 user nova-compute[75017]:   </cpu>
Oct 30 09:53:46 user nova-compute[75017]:   <devices>
Oct 30 09:53:46 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:53:46 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:53:46 user nova-compute[75017]:       <source dev="/dev/sdb"/>
Oct 30 09:53:46 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:53:46 user nova-compute[75017]:       <serial>6258ecf2-8662-4fd7-be2d-8cb8032a378b</serial>
Oct 30 09:53:46 user nova-compute[75017]:     </disk>
Oct 30 09:53:46 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:53:46 user nova-compute[75017]:       <mac address="fa:16:3e:02:29:34"/>
Oct 30 09:53:46 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:53:46 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:53:46 user nova-compute[75017]:       <target dev="tap7fe6cfd7-17"/>
Oct 30 09:53:46 user nova-compute[75017]:     </interface>
Oct 30 09:53:46 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:53:46 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/4e5fc100-7e6f-4dbc-8bbf-12fe983fc479/console.log" append="off"/>
Oct 30 09:53:46 user nova-compute[75017]:     </serial>
Oct 30 09:53:46 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:53:46 user nova-compute[75017]:     <video>
Oct 30 09:53:46 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:53:46 user nova-compute[75017]:     </video>
Oct 30 09:53:46 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:53:46 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:53:46 user nova-compute[75017]:     </rng>
Oct 30 09:53:46 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:53:46 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:53:46 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:53:46 user nova-compute[75017]:     </memballoon>
Oct 30 09:53:46 user nova-compute[75017]:   </devices>
Oct 30 09:53:46 user nova-compute[75017]: </domain>
Oct 30 09:53:46 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:53:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1184143110',display_name='tempest-TestVolumeBootPattern-server-1184143110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1184143110',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsUM189Gj4ZQK8ktc4SfL8GV9WmFPbk65gikfbzax6I4b+Q5HAfpYeqLFZ+I6kJcsujAtPVcto1HAkVmN3/yY4HzAGCLDwxyvqr2x0TZvxr9uVlQnXJ0b4+bg5qwFMY/Q==',key_name='tempest-TestVolumeBootPattern-238078442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-ww7hxscy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:53:27Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=4e5fc100-7e6f-4dbc-8bbf-12fe983fc479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:29:34,bridge_name='br-int',has_traffic_filtering=True,id=7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe6cfd7-17') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG os_vif [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:29:34,bridge_name='br-int',has_traffic_filtering=True,id=7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe6cfd7-17') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '772e02db-b79f-5563-89d4-ba9460248e5c', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fe6cfd7-17, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fe6cfd7-17, col_values=(('qos', UUID('b4f50033-59e7-4c1c-a16b-fb0fbfaba26a')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fe6cfd7-17, col_values=(('external_ids', {'iface-id': '7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:29:34', 'vm-uuid': '4e5fc100-7e6f-4dbc-8bbf-12fe983fc479'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:46 user nova-compute[75017]: INFO os_vif [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:29:34,bridge_name='br-int',has_traffic_filtering=True,id=7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe6cfd7-17')
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:53:46 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No VIF found with MAC fa:16:3e:02:29:34, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-64325931-9ea4-4629-8e2b-8ac50e3d2c92 req-aed192da-a5df-4104-9c84-0178bec83b42 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received event network-vif-plugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-64325931-9ea4-4629-8e2b-8ac50e3d2c92 req-aed192da-a5df-4104-9c84-0178bec83b42 service nova] Acquiring lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-64325931-9ea4-4629-8e2b-8ac50e3d2c92 req-aed192da-a5df-4104-9c84-0178bec83b42 service nova] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-64325931-9ea4-4629-8e2b-8ac50e3d2c92 req-aed192da-a5df-4104-9c84-0178bec83b42 service nova] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG nova.compute.manager [req-64325931-9ea4-4629-8e2b-8ac50e3d2c92 req-aed192da-a5df-4104-9c84-0178bec83b42 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] No waiting events found dispatching network-vif-plugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:53:48 user nova-compute[75017]: WARNING nova.compute.manager [req-64325931-9ea4-4629-8e2b-8ac50e3d2c92 req-aed192da-a5df-4104-9c84-0178bec83b42 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received unexpected event network-vif-plugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb for instance with vm_state building and task_state spawning.
Oct 30 09:53:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:48 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:49 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:49 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:53:49 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:53:49 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Skipping network cache update for instance because it is Building. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 30 09:53:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:53:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:53:49 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:53:49 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updating instance_info_cache with network_info: [{"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:53:50 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Instance spawned successfully.
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-ee3fb1c7-e021-4405-a8bd-b470d3a1ea52 req-4b51f2c3-9d0d-4103-8aea-2ac8db5d48a1 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received event network-vif-plugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ee3fb1c7-e021-4405-a8bd-b470d3a1ea52 req-4b51f2c3-9d0d-4103-8aea-2ac8db5d48a1 service nova] Acquiring lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ee3fb1c7-e021-4405-a8bd-b470d3a1ea52 req-4b51f2c3-9d0d-4103-8aea-2ac8db5d48a1 service nova] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-ee3fb1c7-e021-4405-a8bd-b470d3a1ea52 req-4b51f2c3-9d0d-4103-8aea-2ac8db5d48a1 service nova] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-ee3fb1c7-e021-4405-a8bd-b470d3a1ea52 req-4b51f2c3-9d0d-4103-8aea-2ac8db5d48a1 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] No waiting events found dispatching network-vif-plugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:53:50 user nova-compute[75017]: WARNING nova.compute.manager [req-ee3fb1c7-e021-4405-a8bd-b470d3a1ea52 req-4b51f2c3-9d0d-4103-8aea-2ac8db5d48a1 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received unexpected event network-vif-plugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb for instance with vm_state building and task_state spawning.
Oct 30 09:53:50 user nova-compute[75017]: INFO nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Took 5.01 seconds to spawn the instance on the hypervisor.
Oct 30 09:53:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:53:50 user nova-compute[75017]: INFO nova.compute.manager [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Took 23.65 seconds to build instance.
Oct 30 09:53:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-e027a6e0-5015-4ffe-84f2-12ae3a596a9e tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.748s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:53:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:54 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:53:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:53:58 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:53:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:53:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:54:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:54:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:54:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:54:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:54:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:54:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:54:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:54:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:54:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:54:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:54:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:54:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:54:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:54:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:54:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:54:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:54:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:54:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:38 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-1b267334-4f25-49e6-85b9-a9333923cfe4 req-e517cb4d-7be2-4316-bb3c-dcce938f1b6b service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received event network-changed-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:54:40 user nova-compute[75017]: DEBUG nova.compute.manager [req-1b267334-4f25-49e6-85b9-a9333923cfe4 req-e517cb4d-7be2-4316-bb3c-dcce938f1b6b service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Refreshing instance network info cache due to event network-changed-d1645501-dc40-42cf-b3d3-29e703593dd3. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:54:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1b267334-4f25-49e6-85b9-a9333923cfe4 req-e517cb4d-7be2-4316-bb3c-dcce938f1b6b service nova] Acquiring lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:54:40 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1b267334-4f25-49e6-85b9-a9333923cfe4 req-e517cb4d-7be2-4316-bb3c-dcce938f1b6b service nova] Acquired lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:54:40 user nova-compute[75017]: DEBUG nova.network.neutron [req-1b267334-4f25-49e6-85b9-a9333923cfe4 req-e517cb4d-7be2-4316-bb3c-dcce938f1b6b service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Refreshing network info cache for port d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:54:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-1b267334-4f25-49e6-85b9-a9333923cfe4 req-e517cb4d-7be2-4316-bb3c-dcce938f1b6b service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updated VIF entry in instance network info cache for port d1645501-dc40-42cf-b3d3-29e703593dd3. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:54:41 user nova-compute[75017]: DEBUG nova.network.neutron [req-1b267334-4f25-49e6-85b9-a9333923cfe4 req-e517cb4d-7be2-4316-bb3c-dcce938f1b6b service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updating instance_info_cache with network_info: [{"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:54:41 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1b267334-4f25-49e6-85b9-a9333923cfe4 req-e517cb4d-7be2-4316-bb3c-dcce938f1b6b service nova] Releasing lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:54:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:54:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:44 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:54:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:54:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:54:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=24.9638671875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c1cb620d-70ba-4198-a9f7-7005e903bd6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.objects.instance [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:54:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:54:46 user nova-compute[75017]: INFO nova.compute.manager [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Attaching volume fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 to /dev/vdb
Oct 30 09:54:47 user nova-compute[75017]: DEBUG os_brick.utils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[543706fc-59ff-4add-936f-fb20bd3a3ad0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[206a0ab9-d0d8-4e92-b0fe-403afc8233a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c32e2-3e35-4e9c-a3c1-27e4ab050832]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a55427-549b-4490-aed0-059e805c619c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:54:47 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:54:47 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dcd55e-f13c-4559-b71a-d65bc1ed7723]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG os_brick.utils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:54:47 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updating existing volume attachment record: 22830752-134b-405f-a4f5-2072ef73002f {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:54:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:54:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:54:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:54:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:54:50 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:54:50 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:54:51 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updating instance_info_cache with network_info: [{"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:54:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-c1cb620d-70ba-4198-a9f7-7005e903bd6e" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:54:51 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:54:51 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:51 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:56 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:54:56 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:54:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:54:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:00 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZJvOXNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:55:05 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:55:05 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:55:05 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64eadaa-b9c5-4ca4-8b4b-f94296b0ebb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:55:05 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[902d0afe-92af-4baa-8a64-99a0376f6892]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0] added
Oct 30 09:55:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[865b1b64-8d92-46c7-952a-e487dc4c3070]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756293f-4baa-4e2f-a004-7c544b82a8f0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZJvOXNz {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZJvOXNz" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f81f01e-4fe2-4762-b89a-0f08558ad4b2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZJvOXNz'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[751c0f16-8b8b-4244-b8b8-aff187354b8e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e11870-349f-400f-b192-c4c3caa373b0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d3b9c7-71f3-4d7a-9345-28d76b59ef39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0, portal: 172.16.0.220,3260]
Oct 30 09:55:05 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0, portal: 172.16.0.220,3260] successful.
Oct 30 09:55:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ce77d2-a632-405a-8305-2d6d2996fdd2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cead9b9-07d7-4643-8b01-d75bc1ab2a31]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:05 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:05 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:05 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc9b573-3105-47fd-ac35-aea78d979bf2]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:05 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:55:06 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:55:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZJvOXNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:55:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:55:06 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26562353730633066', 'path': '/dev/sdc'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:55:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562353730633066', 'path': '/dev/sdc'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:55:06 user nova-compute[75017]: DEBUG nova.objects.instance [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:55:06 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:55:06 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:55:06 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:55:06 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:55:06 user nova-compute[75017]:   <serial>fc3d5c08-80ad-4dd9-9be2-183e6f3249e0</serial>
Oct 30 09:55:06 user nova-compute[75017]: </disk>
Oct 30 09:55:06 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:55:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:55:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:55:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:55:07 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No VIF found with MAC fa:16:3e:b5:e8:af, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:55:07 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-3c98f93d-3449-43ae-9a0a-54b72cfc19c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.659s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:55:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:55:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:55:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:55:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:55:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:14 user nova-compute[75017]: INFO nova.compute.manager [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Attaching volume 5f9308b0-9d5e-4db2-8224-8038224e322a to /dev/vdc
Oct 30 09:55:14 user nova-compute[75017]: DEBUG os_brick.utils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb673ab-86b2-4db4-a120-b8bab4be8007]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14b8397-05a3-4ed1-b67d-ec604680d82e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c9b685-4269-4a17-b4b5-64261a27c871]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ea666-1c01-4a07-af67-5478cdde02bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:55:14 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:55:14 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2633ce1a-ac62-4bef-9e8c-efb82ed5284d]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG os_brick.utils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:55:14 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updating existing volume attachment record: 47af878c-013a-4122-89c3-5a591db09fd7 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:55:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:18 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-8c79d210-b5fd-4ce3-9bd8-40b0218292ca req-0fb6153d-6f6f-4a23-b29d-e836b795f86e service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received event network-changed-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:55:18 user nova-compute[75017]: DEBUG nova.compute.manager [req-8c79d210-b5fd-4ce3-9bd8-40b0218292ca req-0fb6153d-6f6f-4a23-b29d-e836b795f86e service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Refreshing instance network info cache due to event network-changed-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:55:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8c79d210-b5fd-4ce3-9bd8-40b0218292ca req-0fb6153d-6f6f-4a23-b29d-e836b795f86e service nova] Acquiring lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:55:18 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8c79d210-b5fd-4ce3-9bd8-40b0218292ca req-0fb6153d-6f6f-4a23-b29d-e836b795f86e service nova] Acquired lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:55:18 user nova-compute[75017]: DEBUG nova.network.neutron [req-8c79d210-b5fd-4ce3-9bd8-40b0218292ca req-0fb6153d-6f6f-4a23-b29d-e836b795f86e service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Refreshing network info cache for port 7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:55:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-8c79d210-b5fd-4ce3-9bd8-40b0218292ca req-0fb6153d-6f6f-4a23-b29d-e836b795f86e service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updated VIF entry in instance network info cache for port 7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:55:19 user nova-compute[75017]: DEBUG nova.network.neutron [req-8c79d210-b5fd-4ce3-9bd8-40b0218292ca req-0fb6153d-6f6f-4a23-b29d-e836b795f86e service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updating instance_info_cache with network_info: [{"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:55:19 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-8c79d210-b5fd-4ce3-9bd8-40b0218292ca req-0fb6153d-6f6f-4a23-b29d-e836b795f86e service nova] Releasing lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:55:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tokVwjLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:55:33 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:55:33 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:55:33 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e383186a-00df-437f-b3d6-73760554e078]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:55:33 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d892c7a5-c01d-4a92-996b-ebc2fe09c645]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a] added
Oct 30 09:55:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[612ab19c-4f37-461a-ba69-253fc3570576]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa72a616-f48e-4b6d-8be3-464842b9a977]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tokVwjLr {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tokVwjLr" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f42287-d5de-4d40-b852-7e407d381078]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tokVwjLr'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e78ed77-5931-4ec9-8626-0a2e725c1814]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c94e10-fbbb-4c17-8fa9-449b46883252]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:33 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:33 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[830aa544-2976-49af-9ed5-595b0e125cac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a, portal: 172.16.0.220,3260]
Oct 30 09:55:33 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a, portal: 172.16.0.220,3260] successful.
Oct 30 09:55:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[980c9ddc-ef4e-4f09-b98d-97e1c8fecfca]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b087d280-c9bd-4dd0-8ea6-994aba53040f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:33 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:33 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:55:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:33 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:33 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:55:33 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[373929f1-8780-4566-be4c-029297892ca1]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:55:33 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tokVwjLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:55:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:55:34 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23438366436393562', 'path': '/dev/sdd'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:55:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438366436393562', 'path': '/dev/sdd'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:55:34 user nova-compute[75017]: DEBUG nova.objects.instance [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:55:34 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 09:55:34 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:55:34 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:55:34 user nova-compute[75017]:   <target dev="vdc" bus="virtio"/>
Oct 30 09:55:34 user nova-compute[75017]:   <serial>5f9308b0-9d5e-4db2-8224-8038224e322a</serial>
Oct 30 09:55:34 user nova-compute[75017]: </disk>
Oct 30 09:55:34 user nova-compute[75017]:  {{(pid=75017) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 09:55:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:55:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:55:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:55:35 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] No VIF found with MAC fa:16:3e:b5:e8:af, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:55:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-c205ff81-117c-4851-a10c-45a26d990a32 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.545s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:55:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:35 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:35 user nova-compute[75017]: DEBUG nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Starting instance... {{(pid=75017) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75017) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 09:55:36 user nova-compute[75017]: INFO nova.compute.claims [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Claim successful on node user
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Start building networks asynchronously for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Allocating IP information in the background. {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.network.neutron [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] allocate_for_instance() {{(pid=75017) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 09:55:36 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Start building block device mappings for instance. {{(pid=75017) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.policy [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd23876ced14c21a33d3c13100323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7428fb3055ac4e39b8e00760816b5bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75017) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 09:55:36 user nova-compute[75017]: INFO nova.virt.block_device [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Booting with volume 0717d1be-7de1-4d19-9486-64d3399fee32 at /dev/vda
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:36 user nova-compute[75017]: INFO nova.compute.manager [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Detaching volume fc3d5c08-80ad-4dd9-9be2-183e6f3249e0
Oct 30 09:55:36 user nova-compute[75017]: DEBUG os_brick.utils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29c8ca4-ca00-4243-bca4-9a99e85ae8ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e7f46b63a3\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:36 user nova-compute[75017]: INFO nova.virt.block_device [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Attempting to driver detach volume fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 from mountpoint /dev/vdb
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa2d45-b3d4-42d6-b761-a696253d61aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Attempting to detach device vdb from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:55:36 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:55:36 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:55:36 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:55:36 user nova-compute[75017]:   <serial>fc3d5c08-80ad-4dd9-9be2-183e6f3249e0</serial>
Oct 30 09:55:36 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:55:36 user nova-compute[75017]: </disk>
Oct 30 09:55:36 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:55:36 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully detached device vdb from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e from the persistent domain config.
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:55:36 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:55:36 user nova-compute[75017]:   <source dev="/dev/sdc"/>
Oct 30 09:55:36 user nova-compute[75017]:   <target dev="vdb" bus="virtio"/>
Oct 30 09:55:36 user nova-compute[75017]:   <serial>fc3d5c08-80ad-4dd9-9be2-183e6f3249e0</serial>
Oct 30 09:55:36 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 09:55:36 user nova-compute[75017]: </disk>
Oct 30 09:55:36 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[a967717c-c756-4377-9f61-c8867a42f0bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c384a154-acf0-414b-a6ec-85406ce9b844]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Running cmd (subprocess): nvme version {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] nvme not present on system {{(pid=75017) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 09:55:36 user nova-compute[75017]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 09:55:36 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1717631d-3f3e-4e2f-af1b-ceb8fb9901a4]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75017) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.lightos [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] LIGHTOS: no hostnqn found. {{(pid=75017) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG os_brick.utils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e7f46b63a3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG nova.virt.block_device [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Updating existing volume attachment record: 5e828389-ef77-4e4c-bb98-eceb78f0ae35 {{(pid=75017) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:55:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Successfully created port: b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Successfully updated port: b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquired lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Building network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-d81f5261-f3b2-4928-a74b-5d885f5c1aa9 req-3a8e1b37-b2e2-4860-9b48-a08a5ef4344d service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received event network-changed-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG nova.compute.manager [req-d81f5261-f3b2-4928-a74b-5d885f5c1aa9 req-3a8e1b37-b2e2-4860-9b48-a08a5ef4344d service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Refreshing instance network info cache due to event network-changed-b135ed8e-54c9-45ff-a614-174ddd97449f. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d81f5261-f3b2-4928-a74b-5d885f5c1aa9 req-3a8e1b37-b2e2-4860-9b48-a08a5ef4344d service nova] Acquiring lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:55:37 user nova-compute[75017]: DEBUG nova.network.neutron [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Instance cache missing network info. {{(pid=75017) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 09:55:38 user nova-compute[75017]: DEBUG nova.network.neutron [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Updating instance_info_cache with network_info: [{"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:55:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Releasing lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:55:38 user nova-compute[75017]: DEBUG nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Instance network_info: |[{"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75017) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 09:55:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d81f5261-f3b2-4928-a74b-5d885f5c1aa9 req-3a8e1b37-b2e2-4860-9b48-a08a5ef4344d service nova] Acquired lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:55:38 user nova-compute[75017]: DEBUG nova.network.neutron [req-d81f5261-f3b2-4928-a74b-5d885f5c1aa9 req-3a8e1b37-b2e2-4860-9b48-a08a5ef4344d service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Refreshing network info cache for port b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:55:38 user nova-compute[75017]: DEBUG nova.network.neutron [req-d81f5261-f3b2-4928-a74b-5d885f5c1aa9 req-3a8e1b37-b2e2-4860-9b48-a08a5ef4344d service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Updated VIF entry in instance network info cache for port b135ed8e-54c9-45ff-a614-174ddd97449f. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:55:38 user nova-compute[75017]: DEBUG nova.network.neutron [req-d81f5261-f3b2-4928-a74b-5d885f5c1aa9 req-3a8e1b37-b2e2-4860-9b48-a08a5ef4344d service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Updating instance_info_cache with network_info: [{"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:55:38 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-d81f5261-f3b2-4928-a74b-5d885f5c1aa9 req-3a8e1b37-b2e2-4860-9b48-a08a5ef4344d service nova] Releasing lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:55:40 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75017) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:55:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:55:46 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:55:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=24.95406723022461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance c1cb620d-70ba-4198-a9f7-7005e903bd6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:55:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:55:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:55:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:55:50 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:55:50 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updating instance_info_cache with network_info: [{"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:55:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:55:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:55:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:51 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:55:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:55:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:55:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:55:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Start spawning the instance on the hypervisor. {{(pid=75017) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Creating instance directory {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 09:55:55 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Creating image(s)
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Did not create local disks {{(pid=75017) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Ensure instance console log exists: /opt/stack/data/nova/instances/b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d/console.log {{(pid=75017) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Start _get_guest_xml network_info=[{"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQUdDoRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d', 'attached_at': '', 'detached_at': '', 'volume_id': '0717d1be-7de1-4d19-9486-64d3399fee32', 'serial': '0717d1be-7de1-4d19-9486-64d3399fee32'}, 'disk_bus': 'virtio', 'attachment_id': '5e828389-ef77-4e4c-bb98-eceb78f0ae35', 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None} {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 09:55:55 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:55:55 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller missing on host. {{(pid=75017) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.host [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU controller found on host. {{(pid=75017) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75017) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T09:08:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image limits 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flavor pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Image pref 0:0:0 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Got 1 possible topologies {{(pid=75017) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.hardware [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75017) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Calling os-brick to attach iSCSI Volume {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQUdDoRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:55:55 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:55:55 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:55:55 user nova-compute[75017]: INFO os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec18e006-6ad8-48fe-91cf-130e1fe4842f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 09:55:55 user nova-compute[75017]:  {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b72215-0abd-4aab-89f5-7cb4fbfc75af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32] added
Oct 30 09:55:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a14de-2622-4044-814f-d2b816961ff3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[2141ce7b-3fe8-4a88-b1fd-02f1f5abd769]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQUdDoRv {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQUdDoRv" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd2364-0a8d-4505-beee-09f6bdaa9540]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQUdDoRv'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb12bac-af95-4a2f-be8b-10fa2c44da5f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f917564d-6e47-4873-b108-5a2d9876062d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:55:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:55:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b0d23-c03d-4acf-b432-84a0eeb90ea2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32, portal: 172.16.0.220,3260]
Oct 30 09:55:55 user nova-compute[75017]: Login to [iface: default, target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32, portal: 172.16.0.220,3260] successful.
Oct 30 09:55:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc4cf1-a17f-493b-8564-e113321c06fa]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[462b3f72-03cb-4825-ab89-9ed64d738247]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)
Oct 30 09:55:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:55:55 user nova-compute[75017]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)
Oct 30 09:55:55 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to 172.16.0.220:3260 {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] HCTL ('36', '-', '-', 0) found on session 57 with lun 0 {{(pid=75017) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75017) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea64fb4-d142-4c39-b76a-c145e4b85406]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75017) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 09:55:55 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQUdDoRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75017) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23265316438646432', 'path': '/dev/sde'} {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265316438646432', 'path': '/dev/sde'} {{(pid=75017) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1498641236',display_name='tempest-TestVolumeBootPattern-server-1498641236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1498641236',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsUM189Gj4ZQK8ktc4SfL8GV9WmFPbk65gikfbzax6I4b+Q5HAfpYeqLFZ+I6kJcsujAtPVcto1HAkVmN3/yY4HzAGCLDwxyvqr2x0TZvxr9uVlQnXJ0b4+bg5qwFMY/Q==',key_name='tempest-TestVolumeBootPattern-238078442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-j4mzh0e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:55:36Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75017) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:65:a2,bridge_name='br-int',has_traffic_filtering=True,id=b135ed8e-54c9-45ff-a614-174ddd97449f,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb135ed8e-54') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.objects.instance [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'pci_devices' on Instance uuid b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 09:55:56 user nova-compute[75017]:   <uuid>b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d</uuid>
Oct 30 09:55:56 user nova-compute[75017]:   <name>instance-00000034</name>
Oct 30 09:55:56 user nova-compute[75017]:   <memory>524288</memory>
Oct 30 09:55:56 user nova-compute[75017]:   <vcpu>1</vcpu>
Oct 30 09:55:56 user nova-compute[75017]:   <metadata>
Oct 30 09:55:56 user nova-compute[75017]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 09:55:56 user nova-compute[75017]:       <nova:package version="0.0.0"/>
Oct 30 09:55:56 user nova-compute[75017]:       <nova:name>tempest-TestVolumeBootPattern-server-1498641236</nova:name>
Oct 30 09:55:56 user nova-compute[75017]:       <nova:creationTime>2023-10-30 09:55:55</nova:creationTime>
Oct 30 09:55:56 user nova-compute[75017]:       <nova:flavor name="m1.tiny">
Oct 30 09:55:56 user nova-compute[75017]:         <nova:memory>512</nova:memory>
Oct 30 09:55:56 user nova-compute[75017]:         <nova:disk>1</nova:disk>
Oct 30 09:55:56 user nova-compute[75017]:         <nova:swap>0</nova:swap>
Oct 30 09:55:56 user nova-compute[75017]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 09:55:56 user nova-compute[75017]:         <nova:vcpus>1</nova:vcpus>
Oct 30 09:55:56 user nova-compute[75017]:       </nova:flavor>
Oct 30 09:55:56 user nova-compute[75017]:       <nova:owner>
Oct 30 09:55:56 user nova-compute[75017]:         <nova:user uuid="5cd23876ced14c21a33d3c13100323a3">tempest-TestVolumeBootPattern-2136848934-project-member</nova:user>
Oct 30 09:55:56 user nova-compute[75017]:         <nova:project uuid="7428fb3055ac4e39b8e00760816b5bb4">tempest-TestVolumeBootPattern-2136848934</nova:project>
Oct 30 09:55:56 user nova-compute[75017]:       </nova:owner>
Oct 30 09:55:56 user nova-compute[75017]:       <nova:ports>
Oct 30 09:55:56 user nova-compute[75017]:         <nova:port uuid="b135ed8e-54c9-45ff-a614-174ddd97449f">
Oct 30 09:55:56 user nova-compute[75017]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 09:55:56 user nova-compute[75017]:         </nova:port>
Oct 30 09:55:56 user nova-compute[75017]:       </nova:ports>
Oct 30 09:55:56 user nova-compute[75017]:     </nova:instance>
Oct 30 09:55:56 user nova-compute[75017]:   </metadata>
Oct 30 09:55:56 user nova-compute[75017]:   <sysinfo type="smbios">
Oct 30 09:55:56 user nova-compute[75017]:     <system>
Oct 30 09:55:56 user nova-compute[75017]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 09:55:56 user nova-compute[75017]:       <entry name="product">OpenStack Nova</entry>
Oct 30 09:55:56 user nova-compute[75017]:       <entry name="version">0.0.0</entry>
Oct 30 09:55:56 user nova-compute[75017]:       <entry name="serial">b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d</entry>
Oct 30 09:55:56 user nova-compute[75017]:       <entry name="uuid">b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d</entry>
Oct 30 09:55:56 user nova-compute[75017]:       <entry name="family">Virtual Machine</entry>
Oct 30 09:55:56 user nova-compute[75017]:     </system>
Oct 30 09:55:56 user nova-compute[75017]:   </sysinfo>
Oct 30 09:55:56 user nova-compute[75017]:   <os>
Oct 30 09:55:56 user nova-compute[75017]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 09:55:56 user nova-compute[75017]:     <boot dev="hd"/>
Oct 30 09:55:56 user nova-compute[75017]:     <smbios mode="sysinfo"/>
Oct 30 09:55:56 user nova-compute[75017]:   </os>
Oct 30 09:55:56 user nova-compute[75017]:   <features>
Oct 30 09:55:56 user nova-compute[75017]:     <acpi/>
Oct 30 09:55:56 user nova-compute[75017]:     <apic/>
Oct 30 09:55:56 user nova-compute[75017]:     <vmcoreinfo/>
Oct 30 09:55:56 user nova-compute[75017]:   </features>
Oct 30 09:55:56 user nova-compute[75017]:   <clock offset="utc">
Oct 30 09:55:56 user nova-compute[75017]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 09:55:56 user nova-compute[75017]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 09:55:56 user nova-compute[75017]:     <timer name="hpet" present="no"/>
Oct 30 09:55:56 user nova-compute[75017]:   </clock>
Oct 30 09:55:56 user nova-compute[75017]:   <cpu mode="custom" match="exact">
Oct 30 09:55:56 user nova-compute[75017]:     <model>Nehalem</model>
Oct 30 09:55:56 user nova-compute[75017]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 09:55:56 user nova-compute[75017]:   </cpu>
Oct 30 09:55:56 user nova-compute[75017]:   <devices>
Oct 30 09:55:56 user nova-compute[75017]:     <disk type="block" device="disk">
Oct 30 09:55:56 user nova-compute[75017]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:55:56 user nova-compute[75017]:       <source dev="/dev/sde"/>
Oct 30 09:55:56 user nova-compute[75017]:       <target dev="vda" bus="virtio"/>
Oct 30 09:55:56 user nova-compute[75017]:       <serial>0717d1be-7de1-4d19-9486-64d3399fee32</serial>
Oct 30 09:55:56 user nova-compute[75017]:     </disk>
Oct 30 09:55:56 user nova-compute[75017]:     <interface type="ethernet">
Oct 30 09:55:56 user nova-compute[75017]:       <mac address="fa:16:3e:dc:65:a2"/>
Oct 30 09:55:56 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:55:56 user nova-compute[75017]:       <mtu size="1442"/>
Oct 30 09:55:56 user nova-compute[75017]:       <target dev="tapb135ed8e-54"/>
Oct 30 09:55:56 user nova-compute[75017]:     </interface>
Oct 30 09:55:56 user nova-compute[75017]:     <serial type="pty">
Oct 30 09:55:56 user nova-compute[75017]:       <log file="/opt/stack/data/nova/instances/b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d/console.log" append="off"/>
Oct 30 09:55:56 user nova-compute[75017]:     </serial>
Oct 30 09:55:56 user nova-compute[75017]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 09:55:56 user nova-compute[75017]:     <video>
Oct 30 09:55:56 user nova-compute[75017]:       <model type="virtio"/>
Oct 30 09:55:56 user nova-compute[75017]:     </video>
Oct 30 09:55:56 user nova-compute[75017]:     <rng model="virtio">
Oct 30 09:55:56 user nova-compute[75017]:       <backend model="random">/dev/urandom</backend>
Oct 30 09:55:56 user nova-compute[75017]:     </rng>
Oct 30 09:55:56 user nova-compute[75017]:     <controller type="usb" index="0" model="none"/>
Oct 30 09:55:56 user nova-compute[75017]:     <memballoon model="virtio">
Oct 30 09:55:56 user nova-compute[75017]:       <stats period="10"/>
Oct 30 09:55:56 user nova-compute[75017]:     </memballoon>
Oct 30 09:55:56 user nova-compute[75017]:   </devices>
Oct 30 09:55:56 user nova-compute[75017]: </domain>
Oct 30 09:55:56 user nova-compute[75017]:  {{(pid=75017) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1498641236',display_name='tempest-TestVolumeBootPattern-server-1498641236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1498641236',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsUM189Gj4ZQK8ktc4SfL8GV9WmFPbk65gikfbzax6I4b+Q5HAfpYeqLFZ+I6kJcsujAtPVcto1HAkVmN3/yY4HzAGCLDwxyvqr2x0TZvxr9uVlQnXJ0b4+bg5qwFMY/Q==',key_name='tempest-TestVolumeBootPattern-238078442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-j4mzh0e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T09:55:36Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:65:a2,bridge_name='br-int',has_traffic_filtering=True,id=b135ed8e-54c9-45ff-a614-174ddd97449f,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb135ed8e-54') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG os_vif [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:65:a2,bridge_name='br-int',has_traffic_filtering=True,id=b135ed8e-54c9-45ff-a614-174ddd97449f,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb135ed8e-54') {{(pid=75017) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b559462-c9ce-5d9e-99ca-bffcc0d7962d', '_type': 'linux-noop'}}, row=False) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb135ed8e-54, may_exist=True, interface_attrs={}) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb135ed8e-54, col_values=(('qos', UUID('d5982585-8640-43a2-bf64-ac8c575c0343')),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb135ed8e-54, col_values=(('external_ids', {'iface-id': 'b135ed8e-54c9-45ff-a614-174ddd97449f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:65:a2', 'vm-uuid': 'b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d'}),), if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:56 user nova-compute[75017]: INFO os_vif [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:65:a2,bridge_name='br-int',has_traffic_filtering=True,id=b135ed8e-54c9-45ff-a614-174ddd97449f,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb135ed8e-54')
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75017) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 09:55:56 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] No VIF found with MAC fa:16:3e:dc:65:a2, not building metadata {{(pid=75017) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 09:55:57 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e is timed out.
Oct 30 09:55:57 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully detached device vdb from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e from the live domain config.
Oct 30 09:55:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZJvOXNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:55:57 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328cc29-7cba-4cef-9b29-ba72dac765e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:55:57 user nova-compute[75017]: No targets found.
Oct 30 09:55:57 user nova-compute[75017]: iSNS:
Oct 30 09:55:57 user nova-compute[75017]: No targets found.
Oct 30 09:55:57 user nova-compute[75017]: STATIC:
Oct 30 09:55:57 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b
Oct 30 09:55:57 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:55:57 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:55:57 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0
Oct 30 09:55:57 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:55:57 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:55:57 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32
Oct 30 09:55:57 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:55:57 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:55:57 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a
Oct 30 09:55:57 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:55:57 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:55:57 user nova-compute[75017]: FIRMWARE:
Oct 30 09:55:57 user nova-compute[75017]: No targets found.
Oct 30 09:55:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:55:57 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:55:57 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc9c735-7728-402a-b8a5-c4bf660f4c43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4744e4-ef79-4d81-a1f9-449ebebf6ab8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:57 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:57 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:55:57 user nova-compute[75017]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)
Oct 30 09:55:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:55:57 user nova-compute[75017]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 (non-flash)
Oct 30 09:55:57 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:55:57 user nova-compute[75017]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)
Oct 30 09:55:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccb0eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0'): ({'sdc'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Removing single pathed devices sdc {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac5aeb7-a641-46e9-b3a3-1943d6c086cf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d3c063-3a99-4be3-97a2-20832fe8d065]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flushing IO for device /dev/sdc {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ec8bfe-6a81-434f-aa2a-ae813bf01ff0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[1465d5db-c417-444d-adc7-c3493e154893]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] SCSI volumes sdc have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[79adaccb-6218-4e48-a40d-b4996b0d32e8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b58455-1ea5-4b48-9d1b-5c7aed4bc9fc]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0, portal: 172.16.0.220,3260]
Oct 30 09:55:57 user nova-compute[75017]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0, portal: 172.16.0.220,3260] successful.
Oct 30 09:55:57 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d5c08-80ad-4dd9-9be2-183e6f3249e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c37025-68f5-452c-82bf-0f33eb0928a3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== disconnect_volume: return (298ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG nova.objects.instance [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-c903590c-a6f8-4168-879b-a9d9c5030788 req-b2246b6f-bb79-4730-81fb-a1e203ab6e22 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received event network-vif-plugged-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c903590c-a6f8-4168-879b-a9d9c5030788 req-b2246b6f-bb79-4730-81fb-a1e203ab6e22 service nova] Acquiring lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c903590c-a6f8-4168-879b-a9d9c5030788 req-b2246b6f-bb79-4730-81fb-a1e203ab6e22 service nova] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-c903590c-a6f8-4168-879b-a9d9c5030788 req-b2246b6f-bb79-4730-81fb-a1e203ab6e22 service nova] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG nova.compute.manager [req-c903590c-a6f8-4168-879b-a9d9c5030788 req-b2246b6f-bb79-4730-81fb-a1e203ab6e22 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] No waiting events found dispatching network-vif-plugged-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:55:58 user nova-compute[75017]: WARNING nova.compute.manager [req-c903590c-a6f8-4168-879b-a9d9c5030788 req-b2246b6f-bb79-4730-81fb-a1e203ab6e22 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received unexpected event network-vif-plugged-b135ed8e-54c9-45ff-a614-174ddd97449f for instance with vm_state building and task_state spawning.
Oct 30 09:55:58 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-99094d58-59ac-4735-bc5b-984edef2a692 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.724s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:55:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:55:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:55:59 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:55:59 user nova-compute[75017]: INFO nova.compute.manager [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Detaching volume 5f9308b0-9d5e-4db2-8224-8038224e322a
Oct 30 09:55:59 user nova-compute[75017]: INFO nova.virt.block_device [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Attempting to driver detach volume 5f9308b0-9d5e-4db2-8224-8038224e322a from mountpoint /dev/vdc
Oct 30 09:55:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Attempting to detach device vdc from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e from the persistent domain config. {{(pid=75017) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 09:55:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:55:59 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:55:59 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:55:59 user nova-compute[75017]:   <target dev="vdc" bus="virtio"/>
Oct 30 09:55:59 user nova-compute[75017]:   <serial>5f9308b0-9d5e-4db2-8224-8038224e322a</serial>
Oct 30 09:55:59 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 09:55:59 user nova-compute[75017]: </disk>
Oct 30 09:55:59 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:55:59 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully detached device vdc from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e from the persistent domain config.
Oct 30 09:55:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e from the live domain config. {{(pid=75017) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 09:55:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.guest [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 09:55:59 user nova-compute[75017]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 09:55:59 user nova-compute[75017]:   <source dev="/dev/sdd"/>
Oct 30 09:55:59 user nova-compute[75017]:   <target dev="vdc" bus="virtio"/>
Oct 30 09:55:59 user nova-compute[75017]:   <serial>5f9308b0-9d5e-4db2-8224-8038224e322a</serial>
Oct 30 09:55:59 user nova-compute[75017]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 09:55:59 user nova-compute[75017]: </disk>
Oct 30 09:55:59 user nova-compute[75017]:  {{(pid=75017) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 09:55:59 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Instance event wait completed in 0 seconds for  {{(pid=75017) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Guest created on hypervisor {{(pid=75017) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 09:56:00 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Instance spawned successfully.
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Found default for hw_cdrom_bus of ide {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Found default for hw_disk_bus of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Found default for hw_input_bus of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Found default for hw_pointer_model of None {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Found default for hw_video_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Found default for hw_vif_model of virtio {{(pid=75017) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 09:56:00 user nova-compute[75017]: INFO nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Took 4.93 seconds to spawn the instance on the hypervisor.
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Checking state {{(pid=75017) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 09:56:00 user nova-compute[75017]: INFO nova.compute.manager [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Took 24.23 seconds to build instance.
Oct 30 09:56:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-4160b364-f7b0-49fa-bb1d-7b43bd3e62fb tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.318s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-0de442e0-a714-4e6e-bbdb-ee484117e643 req-4fbee43f-3af3-4926-8b8a-779c3fcc3a15 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received event network-vif-plugged-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0de442e0-a714-4e6e-bbdb-ee484117e643 req-4fbee43f-3af3-4926-8b8a-779c3fcc3a15 service nova] Acquiring lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0de442e0-a714-4e6e-bbdb-ee484117e643 req-4fbee43f-3af3-4926-8b8a-779c3fcc3a15 service nova] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-0de442e0-a714-4e6e-bbdb-ee484117e643 req-4fbee43f-3af3-4926-8b8a-779c3fcc3a15 service nova] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:00 user nova-compute[75017]: DEBUG nova.compute.manager [req-0de442e0-a714-4e6e-bbdb-ee484117e643 req-4fbee43f-3af3-4926-8b8a-779c3fcc3a15 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] No waiting events found dispatching network-vif-plugged-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:56:00 user nova-compute[75017]: WARNING nova.compute.manager [req-0de442e0-a714-4e6e-bbdb-ee484117e643 req-4fbee43f-3af3-4926-8b8a-779c3fcc3a15 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received unexpected event network-vif-plugged-b135ed8e-54c9-45ff-a614-174ddd97449f for instance with vm_state active and task_state None.
Oct 30 09:56:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:19 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e is timed out.
Oct 30 09:56:19 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully detached device vdc from instance c1cb620d-70ba-4198-a9f7-7005e903bd6e from the live domain config.
Oct 30 09:56:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tokVwjLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:56:19 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac9fcc-4164-40d1-9b2e-68a4d5e173bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:56:19 user nova-compute[75017]: No targets found.
Oct 30 09:56:19 user nova-compute[75017]: iSNS:
Oct 30 09:56:19 user nova-compute[75017]: No targets found.
Oct 30 09:56:19 user nova-compute[75017]: STATIC:
Oct 30 09:56:19 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b
Oct 30 09:56:19 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:56:19 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:56:19 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32
Oct 30 09:56:19 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:56:19 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:56:19 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a
Oct 30 09:56:19 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:56:19 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:56:19 user nova-compute[75017]: FIRMWARE:
Oct 30 09:56:19 user nova-compute[75017]: No targets found.
Oct 30 09:56:19 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:56:19 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:56:19 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9ac399-50f1-4889-bc99-3c98c69d7b44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4e0adf-db16-4523-90bf-bfa76518c315]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:56:19 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:56:19 user nova-compute[75017]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)
Oct 30 09:56:19 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:56:19 user nova-compute[75017]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a (non-flash)
Oct 30 09:56:19 user nova-compute[75017]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)
Oct 30 09:56:19 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccb2ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a'): ({'sdd'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Removing single pathed devices sdd {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5651fa7-26dc-4a4d-806d-93c3cbab6139]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2b76f2-2962-4d48-85e7-c0583b1d0dae]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Flushing IO for device /dev/sdd {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a3e831-66c9-4b3d-9016-f92061c9cdf7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03fffe3-80e3-4743-a1ed-59012b02104f]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] SCSI volumes sdd have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51aad47-08e1-45b1-b068-463bcd8cd903]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e277d5-73b8-4afc-81f3-90ceb993901e]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a, portal: 172.16.0.220,3260]
Oct 30 09:56:19 user nova-compute[75017]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a, portal: 172.16.0.220,3260] successful.
Oct 30 09:56:19 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9308b0-9d5e-4db2-8224-8038224e322a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f46e18-2aa8-403a-ba09-61269a94ff6a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] <== disconnect_volume: return (321ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:56:19 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:56:20 user nova-compute[75017]: DEBUG nova.objects.instance [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'flavor' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:56:20 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-156f6e70-41c3-4594-bfe7-20ca4ceb3115 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.739s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:56:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:56:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:56:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:56:21 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:21 user nova-compute[75017]: INFO nova.compute.manager [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Terminating instance
Oct 30 09:56:21 user nova-compute[75017]: DEBUG nova.compute.manager [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-1a87c4e6-3ac3-4aba-bfd0-9c28b5123ded req-b4254800-74eb-492b-9bd3-47db97f803ad service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received event network-vif-unplugged-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1a87c4e6-3ac3-4aba-bfd0-9c28b5123ded req-b4254800-74eb-492b-9bd3-47db97f803ad service nova] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1a87c4e6-3ac3-4aba-bfd0-9c28b5123ded req-b4254800-74eb-492b-9bd3-47db97f803ad service nova] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-1a87c4e6-3ac3-4aba-bfd0-9c28b5123ded req-b4254800-74eb-492b-9bd3-47db97f803ad service nova] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-1a87c4e6-3ac3-4aba-bfd0-9c28b5123ded req-b4254800-74eb-492b-9bd3-47db97f803ad service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] No waiting events found dispatching network-vif-unplugged-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG nova.compute.manager [req-1a87c4e6-3ac3-4aba-bfd0-9c28b5123ded req-b4254800-74eb-492b-9bd3-47db97f803ad service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received event network-vif-unplugged-d1645501-dc40-42cf-b3d3-29e703593dd3 for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:22 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Instance destroyed successfully.
Oct 30 09:56:22 user nova-compute[75017]: DEBUG nova.objects.instance [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lazy-loading 'resources' on Instance uuid c1cb620d-70ba-4198-a9f7-7005e903bd6e {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-311315715',display_name='tempest-AttachVolumeTestJSON-server-311315715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-311315715',id=50,image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXFGinCXP0Xq3tuA3Euf95/MoDYYx30L6srKx4HHM1MIFtasPWBLWG+XOrxAzUplLbsq6sJzfjPpYIgFB4Q+YyuVDK/lOYBzFpjHQG/grO32Ikp5ySJpo3kpPBM9ouzlw==',key_name='tempest-keypair-1461531926',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:52:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='244a9d4d205d46aa86afe4c739d11557',ramdisk_id='',reservation_id='r-4ncoueru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfd0d0c2-d64f-40a2-8d8e-991cce6f8585',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1415373227',owner_user_name='tempest-AttachVolumeTestJSON-1415373227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fda3d7725f8465097f0ef2b1abb1989',uuid=c1cb620d-70ba-4198-a9f7-7005e903bd6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converting VIF {"id": "d1645501-dc40-42cf-b3d3-29e703593dd3", "address": "fa:16:3e:b5:e8:af", "network": {"id": "c09fc842-fa61-4613-82a9-eaf0b6886e3a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383916247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "244a9d4d205d46aa86afe4c739d11557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1645501-dc", "ovs_interfaceid": "d1645501-dc40-42cf-b3d3-29e703593dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e8:af,bridge_name='br-int',has_traffic_filtering=True,id=d1645501-dc40-42cf-b3d3-29e703593dd3,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1645501-dc') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG os_vif [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e8:af,bridge_name='br-int',has_traffic_filtering=True,id=d1645501-dc40-42cf-b3d3-29e703593dd3,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1645501-dc') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1645501-dc, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6858de30-581a-4d75-b87c-5b47d44bee2b) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:56:22 user nova-compute[75017]: INFO os_vif [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e8:af,bridge_name='br-int',has_traffic_filtering=True,id=d1645501-dc40-42cf-b3d3-29e703593dd3,network=Network(c09fc842-fa61-4613-82a9-eaf0b6886e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1645501-dc')
Oct 30 09:56:22 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Deleting instance files /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e_del
Oct 30 09:56:22 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Deletion of /opt/stack/data/nova/instances/c1cb620d-70ba-4198-a9f7-7005e903bd6e_del complete
Oct 30 09:56:22 user nova-compute[75017]: INFO nova.compute.manager [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 30 09:56:22 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:56:22 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:56:23 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:56:23 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Took 0.67 seconds to deallocate network for instance.
Oct 30 09:56:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:56:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:56:23 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:56:23 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:56:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:23 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Deleted allocations for instance c1cb620d-70ba-4198-a9f7-7005e903bd6e
Oct 30 09:56:23 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-bff5a493-df5a-4be4-8da2-4ba42b0c82c7 tempest-AttachVolumeTestJSON-1415373227 tempest-AttachVolumeTestJSON-1415373227-project-member] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.900s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-036cd608-9001-47fc-84a6-deedeeb819eb req-26e3e617-5cdc-4eaf-97cf-70b7cd786831 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received event network-vif-plugged-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:56:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-036cd608-9001-47fc-84a6-deedeeb819eb req-26e3e617-5cdc-4eaf-97cf-70b7cd786831 service nova] Acquiring lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:56:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-036cd608-9001-47fc-84a6-deedeeb819eb req-26e3e617-5cdc-4eaf-97cf-70b7cd786831 service nova] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:56:24 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-036cd608-9001-47fc-84a6-deedeeb819eb req-26e3e617-5cdc-4eaf-97cf-70b7cd786831 service nova] Lock "c1cb620d-70ba-4198-a9f7-7005e903bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-036cd608-9001-47fc-84a6-deedeeb819eb req-26e3e617-5cdc-4eaf-97cf-70b7cd786831 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] No waiting events found dispatching network-vif-plugged-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:56:24 user nova-compute[75017]: WARNING nova.compute.manager [req-036cd608-9001-47fc-84a6-deedeeb819eb req-26e3e617-5cdc-4eaf-97cf-70b7cd786831 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received unexpected event network-vif-plugged-d1645501-dc40-42cf-b3d3-29e703593dd3 for instance with vm_state deleted and task_state None.
Oct 30 09:56:24 user nova-compute[75017]: DEBUG nova.compute.manager [req-036cd608-9001-47fc-84a6-deedeeb819eb req-26e3e617-5cdc-4eaf-97cf-70b7cd786831 service nova] [instance: c1cb620d-70ba-4198-a9f7-7005e903bd6e] Received event network-vif-deleted-d1645501-dc40-42cf-b3d3-29e703593dd3 {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:56:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:56:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:56:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:56:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:56:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:37 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:56:40 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:56:42 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:56:45 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:56:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:56:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:56:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:45 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:56:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:56:45 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:56:45 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:56:45 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:56:45 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=24.98011016845703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:56:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:56:45 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:56:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:56:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:56:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:56:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:56:46 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:56:46 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:56:46 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:56:46 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:56:47 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:56:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:56:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:56:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:56:51 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:56:52 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:56:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:56:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:56:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:56:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquired lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:56:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Forcefully refreshing network info cache for instance {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 09:56:52 user nova-compute[75017]: DEBUG nova.objects.instance [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lazy-loading 'info_cache' on Instance uuid 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:56:52 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:52 user nova-compute[75017]: DEBUG nova.network.neutron [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updating instance_info_cache with network_info: [{"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:56:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Releasing lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:56:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updated the network info_cache for instance {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 09:56:53 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:56:57 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:56:58 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:56:58 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:57:02 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:57:07 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:57:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:12 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:17 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:57:22 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:57:27 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-f26adf35-6859-4f8d-b1a9-72215836f7a3 req-a79d245f-5787-41b3-8245-2938166541e7 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received event network-changed-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG nova.compute.manager [req-f26adf35-6859-4f8d-b1a9-72215836f7a3 req-a79d245f-5787-41b3-8245-2938166541e7 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Refreshing instance network info cache due to event network-changed-b135ed8e-54c9-45ff-a614-174ddd97449f. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f26adf35-6859-4f8d-b1a9-72215836f7a3 req-a79d245f-5787-41b3-8245-2938166541e7 service nova] Acquiring lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f26adf35-6859-4f8d-b1a9-72215836f7a3 req-a79d245f-5787-41b3-8245-2938166541e7 service nova] Acquired lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG nova.network.neutron [req-f26adf35-6859-4f8d-b1a9-72215836f7a3 req-a79d245f-5787-41b3-8245-2938166541e7 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Refreshing network info cache for port b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG nova.network.neutron [req-f26adf35-6859-4f8d-b1a9-72215836f7a3 req-a79d245f-5787-41b3-8245-2938166541e7 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Updated VIF entry in instance network info cache for port b135ed8e-54c9-45ff-a614-174ddd97449f. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG nova.network.neutron [req-f26adf35-6859-4f8d-b1a9-72215836f7a3 req-a79d245f-5787-41b3-8245-2938166541e7 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Updating instance_info_cache with network_info: [{"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f26adf35-6859-4f8d-b1a9-72215836f7a3 req-a79d245f-5787-41b3-8245-2938166541e7 service nova] Releasing lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:57:28 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:57:28 user nova-compute[75017]: INFO nova.compute.manager [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Terminating instance
Oct 30 09:57:28 user nova-compute[75017]: DEBUG nova.compute.manager [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-f13abb4d-8b6c-444f-b8d8-c41075e1a0ad req-5b65a4c4-dfca-4da2-a89b-c49ad5b71632 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received event network-vif-unplugged-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f13abb4d-8b6c-444f-b8d8-c41075e1a0ad req-5b65a4c4-dfca-4da2-a89b-c49ad5b71632 service nova] Acquiring lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f13abb4d-8b6c-444f-b8d8-c41075e1a0ad req-5b65a4c4-dfca-4da2-a89b-c49ad5b71632 service nova] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f13abb4d-8b6c-444f-b8d8-c41075e1a0ad req-5b65a4c4-dfca-4da2-a89b-c49ad5b71632 service nova] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-f13abb4d-8b6c-444f-b8d8-c41075e1a0ad req-5b65a4c4-dfca-4da2-a89b-c49ad5b71632 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] No waiting events found dispatching network-vif-unplugged-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG nova.compute.manager [req-f13abb4d-8b6c-444f-b8d8-c41075e1a0ad req-5b65a4c4-dfca-4da2-a89b-c49ad5b71632 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received event network-vif-unplugged-b135ed8e-54c9-45ff-a614-174ddd97449f for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:29 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Instance destroyed successfully.
Oct 30 09:57:29 user nova-compute[75017]: DEBUG nova.objects.instance [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'resources' on Instance uuid b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1498641236',display_name='tempest-TestVolumeBootPattern-server-1498641236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1498641236',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsUM189Gj4ZQK8ktc4SfL8GV9WmFPbk65gikfbzax6I4b+Q5HAfpYeqLFZ+I6kJcsujAtPVcto1HAkVmN3/yY4HzAGCLDwxyvqr2x0TZvxr9uVlQnXJ0b4+bg5qwFMY/Q==',key_name='tempest-TestVolumeBootPattern-238078442',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:56:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-j4mzh0e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:56:00Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:65:a2,bridge_name='br-int',has_traffic_filtering=True,id=b135ed8e-54c9-45ff-a614-174ddd97449f,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb135ed8e-54') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_vif [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:65:a2,bridge_name='br-int',has_traffic_filtering=True,id=b135ed8e-54c9-45ff-a614-174ddd97449f,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb135ed8e-54') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb135ed8e-54, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5982585-8640-43a2-bf64-ac8c575c0343) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:57:29 user nova-compute[75017]: INFO os_vif [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:65:a2,bridge_name='br-int',has_traffic_filtering=True,id=b135ed8e-54c9-45ff-a614-174ddd97449f,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb135ed8e-54')
Oct 30 09:57:29 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQUdDoRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:57:29 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48ae44d-dd86-4c2b-9094-32b7e9ea474d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:57:29 user nova-compute[75017]: No targets found.
Oct 30 09:57:29 user nova-compute[75017]: iSNS:
Oct 30 09:57:29 user nova-compute[75017]: No targets found.
Oct 30 09:57:29 user nova-compute[75017]: STATIC:
Oct 30 09:57:29 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b
Oct 30 09:57:29 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:57:29 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:57:29 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32
Oct 30 09:57:29 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:57:29 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:57:29 user nova-compute[75017]: FIRMWARE:
Oct 30 09:57:29 user nova-compute[75017]: No targets found.
Oct 30 09:57:29 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:57:29 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:57:29 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[501e188c-902e-4d39-a586-7ee0230a3282]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b60955-4c02-4ab6-aefb-4ca19205e148]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:57:29 user nova-compute[75017]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)
Oct 30 09:57:29 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:57:29 user nova-compute[75017]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 (non-flash)
Oct 30 09:57:29 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccbcee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32'): ({'sde'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Removing single pathed devices sde {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[16233e99-c27d-412f-b94f-a840cf91e6ae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[911a2c28-5491-42d6-8154-63384a77779e]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flushing IO for device /dev/sde {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1992a-dc25-4311-a40e-68782f0d2be6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e076a5-092f-47e5-9b81-2fd214a4146b]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] SCSI volumes sde have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_109dbcf5', '/dev/disk/by-id/scsi-23265316438646432', '/dev/disk/by-id/scsi-1SCST_BIO109dbcf5-2e1d8dd24b41ea32') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f859d14c-3275-47cd-a6fc-b877fb36b85f]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05e15a6-9417-4d97-860d-eb14dc07d22c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:57:29 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[67126afb-83fe-4243-b8e6-22d2eefd0757]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32, portal: 172.16.0.220,3260]
Oct 30 09:57:30 user nova-compute[75017]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32, portal: 172.16.0.220,3260] successful.
Oct 30 09:57:30 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-18fc3bf1-54a7-45f6-96bb-59ecca0548dc req-5f4b5776-8736-47f2-b7b0-091f5d08e45e service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received event network-changed-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-18fc3bf1-54a7-45f6-96bb-59ecca0548dc req-5f4b5776-8736-47f2-b7b0-091f5d08e45e service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Refreshing instance network info cache due to event network-changed-b135ed8e-54c9-45ff-a614-174ddd97449f. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-18fc3bf1-54a7-45f6-96bb-59ecca0548dc req-5f4b5776-8736-47f2-b7b0-091f5d08e45e service nova] Acquiring lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-18fc3bf1-54a7-45f6-96bb-59ecca0548dc req-5f4b5776-8736-47f2-b7b0-091f5d08e45e service nova] Acquired lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-18fc3bf1-54a7-45f6-96bb-59ecca0548dc req-5f4b5776-8736-47f2-b7b0-091f5d08e45e service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Refreshing network info cache for port b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0717d1be-7de1-4d19-9486-64d3399fee32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c7ec86-6056-434f-acf2-f8aa989cd67b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== disconnect_volume: return (345ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:57:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Deleting instance files /opt/stack/data/nova/instances/b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d_del
Oct 30 09:57:30 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Deletion of /opt/stack/data/nova/instances/b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d_del complete
Oct 30 09:57:30 user nova-compute[75017]: INFO nova.compute.manager [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 30 09:57:30 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:57:30 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Took 0.52 seconds to deallocate network for instance.
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.compute.manager [req-8d4eae17-1325-490c-ab6f-fbfbf4b5fc34 req-7e6435bb-6a67-4626-88f9-aabf64ffcc77 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received event network-vif-deleted-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-18fc3bf1-54a7-45f6-96bb-59ecca0548dc req-5f4b5776-8736-47f2-b7b0-091f5d08e45e service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Updated VIF entry in instance network info cache for port b135ed8e-54c9-45ff-a614-174ddd97449f. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG nova.network.neutron [req-18fc3bf1-54a7-45f6-96bb-59ecca0548dc req-5f4b5776-8736-47f2-b7b0-091f5d08e45e service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Updating instance_info_cache with network_info: [{"id": "b135ed8e-54c9-45ff-a614-174ddd97449f", "address": "fa:16:3e:dc:65:a2", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb135ed8e-54", "ovs_interfaceid": "b135ed8e-54c9-45ff-a614-174ddd97449f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:57:30 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-18fc3bf1-54a7-45f6-96bb-59ecca0548dc req-5f4b5776-8736-47f2-b7b0-091f5d08e45e service nova] Releasing lock "refresh_cache-b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:57:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-eb38e2f5-daf5-4512-82be-aaee416287de req-4357d851-a083-41be-9ea3-fa615a708495 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received event network-vif-plugged-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:57:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eb38e2f5-daf5-4512-82be-aaee416287de req-4357d851-a083-41be-9ea3-fa615a708495 service nova] Acquiring lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:57:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eb38e2f5-daf5-4512-82be-aaee416287de req-4357d851-a083-41be-9ea3-fa615a708495 service nova] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:57:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-eb38e2f5-daf5-4512-82be-aaee416287de req-4357d851-a083-41be-9ea3-fa615a708495 service nova] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:57:31 user nova-compute[75017]: DEBUG nova.compute.manager [req-eb38e2f5-daf5-4512-82be-aaee416287de req-4357d851-a083-41be-9ea3-fa615a708495 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] No waiting events found dispatching network-vif-plugged-b135ed8e-54c9-45ff-a614-174ddd97449f {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:57:31 user nova-compute[75017]: WARNING nova.compute.manager [req-eb38e2f5-daf5-4512-82be-aaee416287de req-4357d851-a083-41be-9ea3-fa615a708495 service nova] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Received unexpected event network-vif-plugged-b135ed8e-54c9-45ff-a614-174ddd97449f for instance with vm_state active and task_state deleting.
Oct 30 09:57:31 user nova-compute[75017]: INFO nova.compute.manager [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d] Took 0.87 seconds to detach 1 volumes for instance.
Oct 30 09:57:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:57:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:57:31 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:57:31 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:57:31 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:57:31 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Deleted allocations for instance b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d
Oct 30 09:57:32 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-281ccf9c-a983-4216-872f-b5f70f357e15 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "b8c3f0bd-3689-4a71-8b6c-4a0fa298b44d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.106s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:57:32 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:57:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:57:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:57:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:57:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:57:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:45 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:57:47 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:57:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:57:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:57:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:57:47 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:57:47 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:57:47 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:57:47 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:57:47 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=24.978412628173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:57:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:57:47 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:57:48 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:57:48 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:57:48 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:57:48 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:57:48 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:57:48 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:57:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:57:49 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:57:49 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:57:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:57:52 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:57:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:57:52 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:57:53 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:57:54 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:57:54 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:57:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:00 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:58:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:58:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:58:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:58:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:58:04 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:09 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:58:14 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:19 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:24 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:58:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:58:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:58:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:58:29 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:34 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:39 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:39 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75017) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 09:58:39 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:44 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:48 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:58:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:58:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:58:48 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:58:48 user nova-compute[75017]: DEBUG nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75017) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 09:58:48 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:58:48 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:58:48 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=24.976943969726562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:58:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:58:48 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:58:49 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Instance 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75017) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 09:58:49 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:58:49 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:58:49 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:58:49 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:58:49 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:58:49 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:58:49 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-f31b76cf-de3e-4785-a815-a860acfa0de0 req-0adc51fd-144b-4969-ada0-b4288ce9fa82 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received event network-changed-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG nova.compute.manager [req-f31b76cf-de3e-4785-a815-a860acfa0de0 req-0adc51fd-144b-4969-ada0-b4288ce9fa82 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Refreshing instance network info cache due to event network-changed-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb. {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f31b76cf-de3e-4785-a815-a860acfa0de0 req-0adc51fd-144b-4969-ada0-b4288ce9fa82 service nova] Acquiring lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f31b76cf-de3e-4785-a815-a860acfa0de0 req-0adc51fd-144b-4969-ada0-b4288ce9fa82 service nova] Acquired lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG nova.network.neutron [req-f31b76cf-de3e-4785-a815-a860acfa0de0 req-0adc51fd-144b-4969-ada0-b4288ce9fa82 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Refreshing network info cache for port 7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:58:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:58:50 user nova-compute[75017]: INFO nova.compute.manager [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Terminating instance
Oct 30 09:58:50 user nova-compute[75017]: DEBUG nova.compute.manager [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Start destroying the instance on the hypervisor. {{(pid=75017) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG nova.network.neutron [req-f31b76cf-de3e-4785-a815-a860acfa0de0 req-0adc51fd-144b-4969-ada0-b4288ce9fa82 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updated VIF entry in instance network info cache for port 7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb. {{(pid=75017) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG nova.network.neutron [req-f31b76cf-de3e-4785-a815-a860acfa0de0 req-0adc51fd-144b-4969-ada0-b4288ce9fa82 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updating instance_info_cache with network_info: [{"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-f31b76cf-de3e-4785-a815-a860acfa0de0 req-0adc51fd-144b-4969-ada0-b4288ce9fa82 service nova] Releasing lock "refresh_cache-4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" {{(pid=75017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 09:58:51 user nova-compute[75017]: INFO nova.virt.libvirt.driver [-] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Instance destroyed successfully.
Oct 30 09:58:51 user nova-compute[75017]: DEBUG nova.objects.instance [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lazy-loading 'resources' on Instance uuid 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479 {{(pid=75017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.vif [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T09:53:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1184143110',display_name='tempest-TestVolumeBootPattern-server-1184143110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1184143110',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsUM189Gj4ZQK8ktc4SfL8GV9WmFPbk65gikfbzax6I4b+Q5HAfpYeqLFZ+I6kJcsujAtPVcto1HAkVmN3/yY4HzAGCLDwxyvqr2x0TZvxr9uVlQnXJ0b4+bg5qwFMY/Q==',key_name='tempest-TestVolumeBootPattern-238078442',keypairs=<?>,launch_index=0,launched_at=2023-10-30T09:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7428fb3055ac4e39b8e00760816b5bb4',ramdisk_id='',reservation_id='r-ww7hxscy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2136848934',owner_user_name='tempest-TestVolumeBootPattern-2136848934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T09:53:50Z,user_data=None,user_id='5cd23876ced14c21a33d3c13100323a3',uuid=4e5fc100-7e6f-4dbc-8bbf-12fe983fc479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converting VIF {"id": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "address": "fa:16:3e:02:29:34", "network": {"id": "6c7bb9ab-d301-4839-88dd-231c2ad19bf9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1647214354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7428fb3055ac4e39b8e00760816b5bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe6cfd7-17", "ovs_interfaceid": "7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG nova.network.os_vif_util [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:34,bridge_name='br-int',has_traffic_filtering=True,id=7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe6cfd7-17') {{(pid=75017) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_vif [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:34,bridge_name='br-int',has_traffic_filtering=True,id=7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe6cfd7-17') {{(pid=75017) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fe6cfd7-17, bridge=br-int, if_exists=True) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4f50033-59e7-4c1c-a16b-fb0fbfaba26a) {{(pid=75017) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:58:51 user nova-compute[75017]: INFO os_vif [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:34,bridge_name='br-int',has_traffic_filtering=True,id=7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb,network=Network(6c7bb9ab-d301-4839-88dd-231c2ad19bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe6cfd7-17')
Oct 30 09:58:51 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] calling os-brick to detach iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cf04e41c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjFQlRnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 09:58:51 user nova-compute[75017]: WARNING os_brick.initiator.connectors.base [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[26693ba8-1523-4f04-8604-7c3d961d4f55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17a5ecde-772e-4549-8314-47037fc4a47a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 09:58:51 user nova-compute[75017]: No targets found.
Oct 30 09:58:51 user nova-compute[75017]: iSNS:
Oct 30 09:58:51 user nova-compute[75017]: No targets found.
Oct 30 09:58:51 user nova-compute[75017]: STATIC:
Oct 30 09:58:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b
Oct 30 09:58:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:58:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:58:51 user nova-compute[75017]: Target: iqn.2010-10.org.openstack:17a5ecde-772e-4549-8314-47037fc4a47a
Oct 30 09:58:51 user nova-compute[75017]:         Portal: 172.16.0.220:3260,-1
Oct 30 09:58:51 user nova-compute[75017]:                 Iface Name: default
Oct 30 09:58:51 user nova-compute[75017]: FIRMWARE:
Oct 30 09:58:51 user nova-compute[75017]: No targets found.
Oct 30 09:58:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 09:58:51 user nova-compute[75017]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 09:58:51 user nova-compute[75017]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75017) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b', 0)] {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d2c4d-4639-4556-be0b-55c83dbc2aed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17a5ecde-772e-4549-8314-47037fc4a47a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffd1ac9-a561-4162-8a06-cb34b1680270]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a5ecde-772e-4549-8314-47037fc4a47a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:58:51 user nova-compute[75017]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a5ecde-772e-4549-8314-47037fc4a47a (non-flash)
Oct 30 09:58:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b (non-flash)
Oct 30 09:58:51 user nova-compute[75017]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a5ecde-772e-4549-8314-47037fc4a47a (non-flash)
Oct 30 09:58:51 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cccf23400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b'): ({'sdb'}, set())}) {{(pid=75017) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Removing single pathed devices sdb {{(pid=75017) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a4024a-2381-4f97-886e-a0d962a2fe07]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01144bb-c981-4673-b5ea-1382e11aef66]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Flushing IO for device /dev/sdb {{(pid=75017) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb6e52f-0cb3-4d2b-9f6c-80703c4b42c9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75017) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba055d7a-0fc3-4013-9ed1-90c422d4d889]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.linuxscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] SCSI volumes sdb have been removed. {{(pid=75017) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b')] {{(pid=75017) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 09:58:51 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[8530d51c-3daa-4b98-8004-3657c9dde6f0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b8539c-8918-411c-bcd7-3f442e3b8367]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260]
Oct 30 09:58:52 user nova-compute[75017]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b, portal: 172.16.0.220,3260] successful.
Oct 30 09:58:52 user nova-compute[75017]:  stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258ecf2-8662-4fd7-be2d-8cb8032a378b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2a7265-c10c-412f-be90-eb60a04cfafb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75017) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.base [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] <== disconnect_volume: return (291ms) None {{(pid=75017) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Disconnected iSCSI Volume {{(pid=75017) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 09:58:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Deleting instance files /opt/stack/data/nova/instances/4e5fc100-7e6f-4dbc-8bbf-12fe983fc479_del
Oct 30 09:58:52 user nova-compute[75017]: INFO nova.virt.libvirt.driver [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Deletion of /opt/stack/data/nova/instances/4e5fc100-7e6f-4dbc-8bbf-12fe983fc479_del complete
Oct 30 09:58:52 user nova-compute[75017]: INFO nova.compute.manager [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo.service.loopingcall [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75017) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.compute.manager [-] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Deallocating network for instance {{(pid=75017) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] deallocate_for_instance() {{(pid=75017) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.network.neutron [-] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Updating instance_info_cache with network_info: [] {{(pid=75017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 09:58:52 user nova-compute[75017]: INFO nova.compute.manager [-] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Took 0.65 seconds to deallocate network for instance.
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-757db832-3a93-4853-a4a5-caf89d199062 req-09f4bea4-ab36-42f1-a8db-7b9af09323ae service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received event network-vif-deleted-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received event network-vif-unplugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] Acquiring lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] No waiting events found dispatching network-vif-unplugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received event network-vif-unplugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb for instance with task_state deleting. {{(pid=75017) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received event network-vif-plugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] Acquiring lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:58:52 user nova-compute[75017]: DEBUG nova.compute.manager [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] No waiting events found dispatching network-vif-plugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb {{(pid=75017) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 09:58:52 user nova-compute[75017]: WARNING nova.compute.manager [req-6701bd57-bc76-4c03-a4ea-7c9dd54eb0f3 req-7175ecef-cf9b-4047-83d9-d372ec4061c7 service nova] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Received unexpected event network-vif-plugged-7fe6cfd7-1777-4b82-b8cd-f8a1469c11cb for instance with vm_state active and task_state deleting.
Oct 30 09:58:53 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:58:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:58:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Skipping network cache update for instance because it is being deleted. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 30 09:58:53 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:58:53 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:53 user nova-compute[75017]: INFO nova.compute.manager [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] [instance: 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479] Took 0.85 seconds to detach 1 volumes for instance.
Oct 30 09:58:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:58:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:58:53 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:58:53 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:58:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:58:53 user nova-compute[75017]: INFO nova.scheduler.client.report [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Deleted allocations for instance 4e5fc100-7e6f-4dbc-8bbf-12fe983fc479
Oct 30 09:58:53 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-eaad624c-3595-4a13-9ca1-af6c83fa8671 tempest-TestVolumeBootPattern-2136848934 tempest-TestVolumeBootPattern-2136848934-project-member] Lock "4e5fc100-7e6f-4dbc-8bbf-12fe983fc479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.992s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:58:54 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:58:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:00 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:00 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 09:59:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:05 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:07 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:09 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Cleaning up deleted instances {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 09:59:09 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] There are 0 instances to clean {{(pid=75017) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 09:59:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:59:16 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:59:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:59:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:59:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:59:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:59:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:41 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:59:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:59:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:59:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:59:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:59:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:59:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75017) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 09:59:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:59:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75017) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 09:59:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:49 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:49 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:50 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:59:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:59:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:59:50 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 09:59:50 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:59:50 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 09:59:50 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=24.967472076416016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 09:59:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 09:59:50 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing inventories for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating ProviderTree inventory for provider f288afb1-3149-4266-a22d-d1442c72ffe3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Updating inventory in ProviderTree for provider f288afb1-3149-4266-a22d-d1442c72ffe3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing aggregate associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, aggregates: None {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Refreshing trait associations for resource provider f288afb1-3149-4266-a22d-d1442c72ffe3, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75017) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 09:59:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 09:59:53 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:54 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 09:59:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 09:59:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 09:59:54 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:55 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 09:59:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 09:59:59 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:00:01 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:00:02 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:00:02 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75017) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:00:06 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:00:11 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:00:16 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:00:21 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:00:26 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:00:31 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:00:36 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:00:41 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:00:42 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:00:46 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75017) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:00:51 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:00:51 user nova-compute[75017]: WARNING nova.virt.libvirt.driver [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:00:51 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Hypervisor/Node resource view: name=user free_ram=9223MB free_disk=24.96404266357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75017) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75017) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG nova.compute.provider_tree [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed in ProviderTree for provider: f288afb1-3149-4266-a22d-d1442c72ffe3 {{(pid=75017) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG nova.scheduler.client.report [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Inventory has not changed for provider f288afb1-3149-4266-a22d-d1442c72ffe3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75017) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG nova.compute.resource_tracker [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Compute_service record updated for user:user {{(pid=75017) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:00:51 user nova-compute[75017]: DEBUG oslo_concurrency.lockutils [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=75017) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:00:54 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:00:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Starting heal instance info cache {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:00:54 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Rebuilding the list of instances to heal {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 10:00:55 user nova-compute[75017]: DEBUG nova.compute.manager [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Didn't find any instances for network info cache update. {{(pid=75017) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 10:00:55 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:00:56 user nova-compute[75017]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75017) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:00:57 user nova-compute[75017]: DEBUG oslo_service.periodic_task [None req-f9f25464-72d5-48b3-916f-d0f589177ee2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75017) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}